00010000:00010000:0.0F:1788970556.124831:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788970556.188618:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970556.188647:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102351104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970556.188705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970556.188759:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351104 00000100:00100000:1.0:1788970556.188765:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351104 00000100:00100000:1.0:1788970556.188816:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0F:1788970556.188826:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788970556.188826:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102351104:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970556.188839:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788970556.188865:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970556.188914:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102351104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970556.188921:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788970556.188944:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970556.188967:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102351104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0F:1788970556.610160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970556.610212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970556.610247:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361088 00000100:00100000:3.0:1788970556.610257:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361088 00000100:00100000:3.0:1788970556.610304:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:3.0:1788970556.610313:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2402:x1875871082361088:12345-192.168.203.15@tcp:16:kworker.0 00000100:00100000:3.0:1788970556.610463:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2402:x1875871082361088:12345-192.168.203.15@tcp:16:kworker.0 Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970556.610471:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1788970556.611926:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082360960 00000100:00100000:0.0:1788970556.611937:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082360960 00002000:00100000:0.0:1788970556.611977:0:18659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8a7d827ea940 x1875871082360960/t0(0) o4->76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp:332/0 lens 504/0 e 0 to 0 dl 1788970567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788970556.611989:0:18659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d827ea940 with x1875871082360960 ext(0->8) 00002000:00010000:0.0:1788970556.611994:0:18659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a7d827ea940 00000100:00100000:0.0:1788970556.613283:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970556.613298:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+8:2402:x1875871082360960:12345-192.168.203.15@tcp:4:bash.0 00000100:00100000:0.0:1788970556.614376:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+10:2402:x1875871082360960:12345-192.168.203.15@tcp:4:bash.0 Request processed in 1076us (4156us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788970556.614575:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00002000:00100000:0.0:1788970556.614587:0:18659:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8a7d827ea940 x1875871082360960/t8589934599(0) o4->76f5674c-81e4-444b-a7b0-2ac4d1e4da63@192.168.203.15@tcp:332/0 lens 504/448 e 0 to 0 dl 1788970567 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788970556.615224:0:18659:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a7d827ea940 with x1875871082360960 ext(0->8) 00002000:00010000:0.0:1788970556.615232:0:18659:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a7d827ea940 00010000:00010000:1.0:1788970557.151623:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970557.212644:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970557.212670:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102351232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970557.212734:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970557.212801:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351232 00000100:00100000:2.0:1788970557.212808:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351232 00000100:00100000:2.0:1788970557.212848:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970557.212857:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102351232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970557.212902:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788970557.212944:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102351232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970557.212951:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970557.213207:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102351232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970557.213228:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102351360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970557.213251:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970557.217268:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351360 00000100:00100000:0.0:1788970557.217282:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351360 00000100:00100000:0.0:1788970557.218488:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788970557.218503:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102351360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970557.218538:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970557.218626:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102351360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (5374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970557.218634:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788970557.218712:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102351360:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970558.180001:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970558.368684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970558.371293:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361216 00000100:00100000:1.0:1788970558.371316:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361216 00000100:00080000:3.0:1788970558.371439:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970558.371462:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:1.0:1788970558.371479:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15561:x1875871082361216:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788970558.371641:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15561:x1875871082361216:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 167us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.371649:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:1.0:1788970558.380241:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970558.380972:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361344 00000100:00100000:1.0:1788970558.380987:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361344 00000100:00100000:1.0:1788970558.381068:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:1.0:1788970558.381092:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15561:x1875871082361344:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788970558.381222:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:15561:x1875871082361344:12345-192.168.203.15@tcp:60:lhsmtool_posix.0 Request processed in 131us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.381245:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00080000:1.0:1788970558.381272:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970558.386408:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970558.387116:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361600 00000100:00100000:3.0:1788970558.387131:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361600 00000100:00100000:3.0:1788970558.387214:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:3.0:1788970558.387226:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafadbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+25:15561:x1875871082361600:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970558.389020:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafadbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+26:15561:x1875871082361600:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1787us (2643us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788970558.389036:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000001:00080000:1.0:1788970558.401627:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:1.0:1788970558.401682:0:17130:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a7eaecf6600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788970558.401691:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d824f7200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a7eaecf6d80 00000020:00080000:1.0:1788970558.401697:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a7d824f7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a7d822d1e00 00010000:00010000:3.0:1788970558.401698:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970558.401719:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970558.401729:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970558.401742:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:3.0:1788970558.401758:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f4e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970558.401763:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970558.401771:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970558.401798:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:3.0:1788970558.401802:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970558.401808:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970558.401814:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f4e00/0xc3abfebe76c701d7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788970558.401859:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788970558.748580:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970558.748603:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102351488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970558.748685:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970558.748688:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970558.748699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102351616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970558.748727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970558.748756:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351488 00000100:00100000:3.0:1788970558.748763:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351488 00000100:00100000:1.0:1788970558.748865:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351616 00000100:00100000:1.0:1788970558.748870:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351616 00000100:00100000:1.0:1788970558.748931:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970558.748942:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102351616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970558.748969:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788970558.749018:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102351616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.749025:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970558.749066:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102351616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970558.749587:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970558.749599:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102351744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970558.749633:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970558.749730:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351744 00000100:00100000:3.0:1788970558.749735:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351744 00000100:00100000:3.0:1788970558.749753:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788970558.749759:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102351488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970558.749852:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970558.749885:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788970558.749889:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102351488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970558.749892:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102351744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970558.749896:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00002000:00000024:2.0:1788970558.749904:0:20378:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970558.749935:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102351744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970558.749940:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970558.749977:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102351744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970558.750147:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102352256:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750175:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750195:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102352768:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750217:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750235:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788970558.750241:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102351872:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750267:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750311:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102352384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750336:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750355:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102352896:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750374:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750420:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352256 00000100:00100000:1.0:1788970558.750424:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352256 00000100:00100000:1.0:1788970558.750452:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788970558.750458:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102352256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750497:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102352256:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.750504:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788970558.750523:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352768 00000100:00100000:1.0:1788970558.750526:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352768 00000100:00100000:1.0:1788970558.750563:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352896 00000100:00100000:1.0:1788970558.750567:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352896 00000100:00100000:1.0:1788970558.750589:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970558.750595:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102352768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750625:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102352768:12345-0@lo:400:kworker.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.750630:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970558.750642:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788970558.750647:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102352896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750671:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102352896:12345-0@lo:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.750676:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788970558.750693:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102351872 00000100:00100000:1.0:1788970558.750696:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102351872 00000100:00100000:1.0:1788970558.750725:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788970558.750731:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102351872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750761:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102351872:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.750767:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788970558.750794:0:19710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352384 00000100:00100000:1.0:1788970558.750798:0:19710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352384 00000100:00100000:1.0:1788970558.750823:0:19710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970558.750830:0:19710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102352384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750858:0:19710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102352384:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.750864:0:19710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970558.750892:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102352000:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750914:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102352512:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750950:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.750965:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102353024:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.750985:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.751001:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788970558.751007:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102352128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751040:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.751058:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102352640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970558.751117:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352512 00000100:00100000:1.0:1788970558.751121:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352512 00000100:00100000:1.0:1788970558.751138:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353024 00000100:00100000:1.0:1788970558.751145:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353024 00000100:00100000:1.0:1788970558.751157:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352128 00000100:00100000:1.0:1788970558.751159:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352128 00000100:00100000:1.0:1788970558.751167:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352640 00000100:00100000:1.0:1788970558.751169:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352640 00000100:00100000:1.0:1788970558.751181:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970558.751186:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102352512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751222:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102352512:12345-0@lo:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.751227:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970558.751239:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788970558.751245:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102353024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751270:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102353024:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.751276:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788970558.751287:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970558.751292:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102352128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751318:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102352128:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.751324:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788970558.751334:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788970558.751340:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102352640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751365:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102352640:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970558.751371:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000001:00080000:3.0:1788970558.751419:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000100:00100000:1.0:1788970558.751425:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102351872:0@lo:400:kworker.0 00000001:00080000:3.0:1788970558.751430:0:19469:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1788970558.751446:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102352384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751454:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102352896:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751463:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102352256:0@lo:400:kworker.0 00010000:00080000:1.0:1788970558.751473:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebdb6f840 x1875871102352768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970558.751483:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102352768:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751514:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102352128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751522:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102352640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970558.751529:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102352512:0@lo:400:kworker.0 00010000:00080000:1.0:1788970558.751536:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebdb6f0c0 x1875871102353024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970558.751544:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102353024:0@lo:400:kworker.0 00000100:00080000:0.0:1788970558.751759:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970558.751764:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970558.751766:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970558.751768:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970558.751793:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102352000 00000100:00100000:0.0:1788970558.751798:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102352000 00000100:00100000:0.0:1788970558.751833:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970558.751841:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102352000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970558.751887:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102352000:12345-0@lo:400:kworker.0 Request processed in 47us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970558.751893:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788970558.751926:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102351488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970558.752129:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102352000:0@lo:400:kworker.0 00010000:00010000:0.0:1788970559.202099:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970560.178097:0:20525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:15:58 (1788970558) 00010000:00010000:3.0:1788970560.226637:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970560.711982:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970560.712032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970560.712075:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970560.712102:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361728 00000100:00100000:0.0:1788970560.712114:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361728 00000100:00100000:0.0:1788970560.712173:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:0.0:1788970560.712183:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2401:x1875871082361728:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970560.712256:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2401:x1875871082361728:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.712264:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 168 00000100:00100000:0.0:1788970560.712422:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361984 00000100:00100000:0.0:1788970560.712427:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361984 00000100:00100000:0.0:1788970560.712472:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082361856 00000100:00100000:0.0:1788970560.712475:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082361856 00000100:00080000:2.0:1788970560.712485:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970560.712491:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970560.712501:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:0.0:1788970560.712510:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2401:x1875871082361984:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970560.712566:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2401:x1875871082361984:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.712573:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 72 00000100:00100000:0.0:1788970560.712588:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:0.0:1788970560.712595:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+12:2401:x1875871082361856:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970560.712639:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+12:2401:x1875871082361856:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 45us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.712644:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 73 00000100:00100000:3.0:1788970560.716274:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970560.716311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970560.716334:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970560.716359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970560.716546:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970560.716570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970560.718511:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362112 00000100:00100000:2.0:1788970560.718523:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362112 00000100:00100000:2.0:1788970560.718913:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362624 00000100:00100000:2.0:1788970560.718919:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362624 00000100:00100000:2.0:1788970560.718939:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362752 00000100:00100000:2.0:1788970560.718942:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362752 00000100:00100000:2.0:1788970560.718955:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362240 00000100:00100000:2.0:1788970560.718957:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362240 00000100:00100000:2.0:1788970560.718978:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1788970560.718988:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2400:x1875871082362240:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970560.719073:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2400:x1875871082362240:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 86us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970560.719081:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:2.0:1788970560.719099:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1788970560.719106:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2399:x1875871082362112:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:2.0:1788970560.719125:0:18656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fe8f 00000100:00080000:2.0:1788970560.719139:0:18656:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbacb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970560.719919:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788970560.720072:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+2:2399:x1875871082362112:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 964us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970560.720081:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:2.0:1788970560.720101:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1788970560.720119:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2399:x1875871082362624:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:2.0:1788970560.720136:0:18656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fece 00000100:00080000:2.0:1788970560.720143:0:18656:0:(import.c:65:import_set_state_nolock()) ffff8a7d831dc000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788970560.720171:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000001:00000004:2.0:1788970560.720172:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788970560.720186:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2399:x1875871082362752:12345-192.168.203.15@tcp:9:kworker.0 00000020:00000080:0.0:1788970560.720202:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fed5 00000100:00080000:0.0:1788970560.720212:0:18654:0:(import.c:65:import_set_state_nolock()) ffff8a7d831d8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970560.720239:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788970560.720314:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+2:2399:x1875871082362752:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 133us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.720321:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00010000:00010000:0.0:1788970560.720367:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970560.720378:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362496 00000100:00100000:0.0:1788970560.720398:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362496 00000100:00100000:0.0:1788970560.720426:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362368 00000100:00100000:0.0:1788970560.720428:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362368 00000100:00100000:0.0:1788970560.720444:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:0.0:1788970560.720451:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082362496:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970560.720475:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2400:x1875871082362496:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.720491:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 74 00000100:00100000:0.0:1788970560.720506:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 75 00000100:00100000:0.0:1788970560.720512:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2400:x1875871082362368:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970560.720549:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2400:x1875871082362368:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 37us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970560.720556:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 75 00010000:00010000:0.0:1788970560.720614:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970560.720621:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970560.720625:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970560.720627:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788970560.720629:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970560.720768:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7365f4d7-b3e1-4126-9092-d6317f98dfcc+2:2399:x1875871082362624:12345-192.168.203.15@tcp:9:kworker.0 Request processed in 651us (4455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970560.720777:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00010000:00010000:0.0:1788970560.720793:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970560.924547:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970560.924556:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970560.924577:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788970560.924583:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788970561.246025:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970561.309627:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970561.309649:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102353152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970561.309716:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970561.309858:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353152 00000100:00100000:2.0:1788970561.309866:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353152 00000100:00100000:2.0:1788970561.309926:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788970561.309936:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102353152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970561.309965:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970561.310012:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102353152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970561.310019:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788970561.310087:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970561.310122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102353152:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788970562.077199:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970562.268847:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970562.332770:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970562.332842:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970562.333283:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353280 00000100:00100000:0.0:1788970562.333292:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353280 00000100:00100000:0.0:1788970562.333353:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788970562.333362:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970562.333432:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970562.333492:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970562.333499:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970562.333653:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970562.335178:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83dde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102353408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970562.335250:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970562.335463:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353408 00000100:00100000:1.0:1788970562.335472:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353408 00000100:00100000:1.0:1788970562.335527:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788970562.335537:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102353408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970562.335570:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788970562.335628:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102353408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970562.335634:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788970562.335715:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83dde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102353408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788970563.292651:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970563.775423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970563.775467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970563.775512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970563.776873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970563.776936:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082363392 00000100:00100000:3.0:1788970563.776946:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082363392 00000100:00100000:3.0:1788970563.777010:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:3.0:1788970563.777021:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+6:2399:x1875871082363392:12345-192.168.203.15@tcp:9:umount.0 00000020:00000080:3.0:1788970563.777068:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fe96 00000020:00010000:3.0:1788970563.777076:0:18654:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7eb3e10800: total 0 00000100:00080000:3.0:1788970563.777080:0:18654:0:(import.c:65:import_set_state_nolock()) ffff8a7ebdabe000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970563.777121:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788970563.777252:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+4:2399:x1875871082363392:12345-192.168.203.15@tcp:9:umount.0 Request processed in 233us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970563.777260:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000020:00010000:3.0:1788970563.777295:0:19487:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7eb3e10800: total 0 00010000:00010000:3.0:1788970563.777317:0:19487:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7eb3e10800, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788970563.777346:0:19487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788970563.777350:0:19487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788970563.777375:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073334602/0xc3abfebe76c70201 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd08 expref: 3 pid: 19710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.777439:0:19487:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7eb3e10800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1788970563.777453:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082362880 00010000:00010000:3.0:1788970563.777456:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970563.777460:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970563.777460:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082362880 00010000:00010000:3.0:1788970563.777462:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970563.777493:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082363136 00000100:00100000:0.0:1788970563.777497:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082363136 00000100:00100000:0.0:1788970563.777523:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082363008 00000100:00100000:0.0:1788970563.777525:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082363008 00000100:00100000:1.0:1788970563.777530:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1788970563.777540:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+15:2401:x1875871082362880:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970563.777551:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1788970563.777554:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788970563.777564:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c6fe6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db41 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970563.777653:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970563.777690:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+14:2401:x1875871082362880:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 153us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.777697:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1788970563.777713:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970563.777719:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+13:2401:x1875871082363136:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970563.777726:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970563.777736:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3400/0xc3abfebe76c6ff30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc28 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970563.777745:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970563.777763:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:2401:x1875871082363136:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 44us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.777779:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970563.777794:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1788970563.777800:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:2401:x1875871082363008:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970563.777811:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970563.777820:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3800/0xc3abfebe76c6fe73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db72 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970563.777829:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970563.777847:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:2401:x1875871082363008:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 47us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.777852:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1788970563.792413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970563.792497:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082364288 00000100:00100000:0.0:1788970563.792508:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082364288 00000100:00100000:0.0:1788970563.792600:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 76 00000100:00100000:0.0:1788970563.792611:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+12:2399:x1875871082364288:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:0.0:1788970563.792644:0:17152:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fe88 00000020:00010000:0.0:1788970563.792661:0:17152:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83efc800: total 0 00000100:00080000:0.0:1788970563.792666:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8a7d83ef9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970563.792699:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00080000:1.0:1788970563.792854:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788970563.792961:0:17138:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83efc800: total 0 00010000:00010000:3.0:1788970563.792966:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970563.793015:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83efc800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788970563.793058:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7eb0e83300) 00010000:00010000:3.0:1788970563.793062:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970563.793070:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2800/0xc3abfebe76c6ff68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc36 expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793097:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a7eb0e83a00) 00010000:00010000:3.0:1788970563.793100:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970563.793104:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7ec21f5e00/0xc3abfebe76c701ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dce5 expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793120:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:3.0:1788970563.793123:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970563.793127:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025a00/0xc3abfebe76c6ffa7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc44 expref: 9 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793161:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970563.793164:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970563.793168:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed99a00/0xc3abfebe76c70152 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dcd0 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793192:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a7eb0e83f00) 00010000:00010000:3.0:1788970563.793195:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788970563.793198:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ae00/0xc3abfebe76c70216 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd0f expref: 7 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793213:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7eb0e83800) 00010000:00010000:3.0:1788970563.793215:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970563.793218:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8000/0xc3abfebe76c6ff4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc2f expref: 6 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793233:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a7eb0e83000) 00010000:00010000:3.0:1788970563.793235:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788970563.793238:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7002c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc6e expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970563.793250:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83efc800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788970563.793263:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970563.793265:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970563.793267:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970563.794338:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+3:2399:x1875871082364288:12345-192.168.203.15@tcp:39:umount.0 Request processed in 1723us (1953us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788970563.794350:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 76 00000001:00100000:0.0:1788970563.798207:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00080000:0.0:1788970563.798225:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:0.0:1788970563.798231:0:17130:0:(genops.c:885:class_export_put()) final put ffff8a7d83efc800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000020:00080000:0.0:1788970563.798304:0:17130:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788970563.798430:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788970563.798441:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00000080:1.0:1788970563.798612:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83efc800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 for lustre-MDT0000 00000020:00000080:1.0:1788970563.798949:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83ef9800 for lustre-MDT0000 00000100:00100000:3.0:1788970563.804715:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970563.804899:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082364416 00000100:00100000:0.0:1788970563.804910:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082364416 00000100:00100000:0.0:1788970563.804991:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 77 00000100:00100000:0.0:1788970563.805002:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+5:2399:x1875871082364416:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:0.0:1788970563.805044:0:19483:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fe81 00000100:00080000:0.0:1788970563.805061:0:19483:0:(import.c:65:import_set_state_nolock()) ffff8a7d8368d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970563.805098:0:19483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788970563.805355:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e898fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f5674c-81e4-444b-a7b0-2ac4d1e4da63+3:2399:x1875871082364416:12345-192.168.203.15@tcp:39:umount.0 Request processed in 352us (645us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788970563.805364:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 77 00010000:00010000:3.0:1788970563.805491:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970563.805545:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970563.869462:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102353664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869547:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970563.869604:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102354176:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970563.869647:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102354688:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.869665:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353664 00000100:00100000:3.0:1788970563.869669:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.869672:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353664 00000100:00100000:3.0:1788970563.869688:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102355200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788970563.869709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.869711:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354176 00000100:00100000:1.0:1788970563.869713:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354176 00000100:00100000:1.0:1788970563.869728:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970563.869729:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788970563.869735:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102353536:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.869735:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102353664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869758:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970563.869780:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.869781:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102353664:12345-0@lo:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.869787:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788970563.869798:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.869802:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970563.869808:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102354176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869811:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102354560:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.869841:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83edb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102354176:12345-0@lo:400:kworker.0 Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.869847:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788970563.869848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102355072:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869867:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.869884:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354688 00000100:00100000:1.0:1788970563.869887:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354688 00000100:00100000:3.0:1788970563.869895:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102353664:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.869904:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102354176:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.869914:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354048 00000100:00100000:1.0:1788970563.869916:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354048 00000100:00100000:1.0:1788970563.869925:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354560 00000100:00100000:1.0:1788970563.869927:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354560 00000100:00100000:3.0:1788970563.869933:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355200 00000100:00100000:3.0:1788970563.869936:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355200 00000100:00100000:1.0:1788970563.869950:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355072 00000100:00100000:1.0:1788970563.869953:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355072 00000100:00100000:3.0:1788970563.869960:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970563.869965:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788970563.869967:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102355200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970563.869970:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102354688:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788970563.869986:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788970563.870003:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83eda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102354688:12345-0@lo:400:kworker.0 Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870009:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788970563.870014:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102355200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870021:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788970563.870026:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970563.870026:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102354048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.870057:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353536 00000100:00100000:3.0:1788970563.870061:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353536 00000100:00100000:1.0:1788970563.870063:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102354048:12345-0@lo:400:kworker.0 Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870068:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788970563.870083:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788970563.870089:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870089:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788970563.870094:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102354560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.870116:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102353536:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870116:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102354560:12345-0@lo:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970563.870123:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788970563.870123:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788970563.870132:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788970563.870145:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102355072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.870151:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102353536:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.870161:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102354048:0@lo:400:kworker.0 00000100:00100000:3.0:1788970563.870168:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870171:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102355072:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870177:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788970563.870178:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebcf612c0 x1875871102355072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970563.870188:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102355072:0@lo:400:kworker.0 00000100:00080000:1.0:1788970563.870191:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970563.870196:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102354688:0@lo:400:kworker.0 00000100:00080000:1.0:1788970563.870196:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970563.870198:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970563.870203:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788970563.870208:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7d83e8da40, transno 8589934596 00000100:00100000:1.0:1788970563.870210:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353792:0@lo:400:kworker.0 00000004:00080000:3.0:1788970563.870216:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788970563.870234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83eda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102355200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970563.870234:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870249:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102354304:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870267:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870284:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102354816:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870303:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870321:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788970563.870327:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353920:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870344:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870357:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102354432:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870375:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870412:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102354944:0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870431:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870453:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354816 00000100:00100000:1.0:1788970563.870457:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354816 00000100:00100000:1.0:1788970563.870479:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354944 00000100:00100000:1.0:1788970563.870482:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354944 00000100:00100000:1.0:1788970563.870498:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788970563.870504:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102354816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870628:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102354816:12345-0@lo:400:kworker.0 Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870636:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788970563.870652:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788970563.870659:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102354944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970563.870689:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102354944:12345-0@lo:400:kworker.0 Request processed in 31us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970563.870693:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788970563.870709:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970563.870712:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970563.870720:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102355328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970563.870740:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970563.870760:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102354944:0@lo:400:kworker.0 00010000:00080000:1.0:1788970563.870771:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebcf60b40 x1875871102354816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970563.870779:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102354816:0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.870986:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355328 00000100:00100000:2.0:1788970563.870991:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355328 00000100:00100000:2.0:1788970563.871054:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970563.871063:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102355328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970563.871084:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970563.871127:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102355328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970563.871134:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970563.871247:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353792 00000100:00100000:2.0:1788970563.871252:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353792 00000100:00100000:2.0:1788970563.871286:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354304 00000100:00100000:2.0:1788970563.871289:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354304 00000100:00100000:2.0:1788970563.871300:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102353920 00000100:00100000:2.0:1788970563.871302:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102353920 00000100:00100000:2.0:1788970563.871312:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102354432 00000100:00100000:2.0:1788970563.871314:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102354432 00000100:00100000:2.0:1788970563.871327:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970563.871332:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871365:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353792:12345-0@lo:400:kworker.0 Request processed in 32us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970563.871371:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970563.871408:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970563.871415:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102354304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871442:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102354304:12345-0@lo:400:kworker.0 Request processed in 29us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970563.871447:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788970563.871457:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970563.871461:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871484:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102353920:12345-0@lo:400:kworker.0 Request processed in 23us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970563.871495:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970563.871505:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970563.871510:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102354432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871535:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102354432:12345-0@lo:400:kworker.0 Request processed in 25us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970563.871541:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788970563.871602:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102355328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970563.871612:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353920:0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871627:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102353792:0@lo:400:kworker.0 00000100:00100000:2.0:1788970563.871635:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102354304:0@lo:400:kworker.0 00000100:00100000:0.0:1788970563.872158:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102355456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970563.872202:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970563.872244:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355456 00000100:00100000:0.0:1788970563.872248:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355456 00000100:00100000:0.0:1788970563.872290:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970563.872297:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102355456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970563.872311:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788970563.872345:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83dde940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102355456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970563.872351:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970563.872413:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102355456:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788970563.872637:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788970563.872642:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788970564.319703:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970565.301614:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970565.301656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970565.301695:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082364672 00000100:00100000:1.0:1788970565.301706:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082364672 00000100:00100000:2.0:1788970565.301774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970565.301800:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082364544 00000100:00100000:2.0:1788970565.301805:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082364544 00000100:00100000:1.0:1788970565.301836:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082364800 00000100:00100000:2.0:1788970565.301842:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1788970565.301842:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082364800 00000100:00100000:2.0:1788970565.301856:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+12:2401:x1875871082364672:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970565.301871:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970565.301890:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9200/0xc3abfebe76c6feb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbe2 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970565.301906:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970565.301975:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+11:2401:x1875871082364672:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970565.301983:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970565.302002:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970565.302009:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+10:2401:x1875871082364544:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970565.302016:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970565.302036:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df2600/0xc3abfebe76c6feab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dbb1 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970565.302046:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970565.302068:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+9:2401:x1875871082364544:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 60us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970565.302074:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970565.302091:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1788970565.302099:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+8:2400:x1875871082364800:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970565.302108:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970565.302119:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c6ff29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc21 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970565.302130:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970565.302164:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+7:2400:x1875871082364800:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 67us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970565.302170:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1788970565.310290:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970565.310467:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365056 00000100:00100000:1.0:1788970565.310478:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365056 00000100:00100000:1.0:1788970565.310551:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 78 00000100:00100000:1.0:1788970565.310562:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+6:2399:x1875871082365056:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:1.0:1788970565.310618:0:17151:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fec0 00000020:00010000:1.0:1788970565.310626:0:17151:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83efa000: total 0 00000100:00080000:1.0:1788970565.310630:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a7d83efe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788970565.310661:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00080000:2.0:1788970565.310759:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970565.310987:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2399:x1875871082365056:12345-192.168.203.15@tcp:39:umount.0 Request processed in 426us (706us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1788970565.310995:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 78 00000020:00010000:3.0:1788970565.311642:0:17138:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83efa000: total 0 00010000:00010000:3.0:1788970565.311706:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83efa000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788970565.311742:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83361900) 00010000:00010000:3.0:1788970565.311754:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788970565.311764:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83025e00/0xc3abfebe76c6ffb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dc4b expref: 4 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970565.311786:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83efa000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788970565.311799:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970565.311800:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970565.311802:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970565.319844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970565.320110:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365184 00000100:00100000:2.0:1788970565.320122:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365184 00000100:00100000:2.0:1788970565.320222:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00100000:2.0:1788970565.320233:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+5:2399:x1875871082365184:12345-192.168.203.15@tcp:39:umount.0 00000020:00000080:2.0:1788970565.320287:0:17150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fec7 00000100:00080000:2.0:1788970565.320298:0:17150:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970565.320334:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788970565.320517:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7365f4d7-b3e1-4126-9092-d6317f98dfcc+3:2399:x1875871082365184:12345-192.168.203.15@tcp:39:umount.0 Request processed in 285us (683us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788970565.320525:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 79 00000100:00080000:1.0:1788970565.320935:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788970565.321149:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970565.340614:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970565.375481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970565.375575:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365440 00000100:00100000:1.0:1788970565.375588:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365440 00000100:00100000:1.0:1788970565.375647:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 170 00000100:00100000:1.0:1788970565.375658:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+7:2399:x1875871082365440:12345-192.168.203.15@tcp:251:umount.0 00000020:00000080:1.0:1788970565.375705:0:17143:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fe5e 00000020:00010000:1.0:1788970565.375714:0:17143:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83688000: total 0 00000100:00080000:1.0:1788970565.375719:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8a7d8368b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788970565.375796:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0216bee-468c-4e54-8bfe-6d61bf429fa4+3:2399:x1875871082365440:12345-192.168.203.15@tcp:251:umount.0 Request processed in 139us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970565.375803:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 170 00000020:00010000:0.0:1788970565.376030:0:17138:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83688000: total 0 00010000:00010000:0.0:1788970565.376083:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83688000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788970565.376115:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9600/0xc3abfebe76c6fe65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8db3a expref: 2 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970565.376130:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83688000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788970565.376140:0:17138:0:(genops.c:885:class_export_put()) final put ffff8a7d83688000/f0216bee-468c-4e54-8bfe-6d61bf429fa4 00010000:00010000:0.0:1788970565.376160:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970565.376162:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970565.376164:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788970565.376200:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83688000/f0216bee-468c-4e54-8bfe-6d61bf429fa4 for MGS 00000020:00000080:1.0:1788970565.376237:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d8368b800 for MGS 00010000:00010000:2.0:1788970566.365049:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970566.435303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102355584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970566.435376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970566.435447:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355584 00000100:00100000:0.0:1788970566.435456:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355584 00000100:00100000:0.0:1788970566.435600:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970566.435611:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102355584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788970566.435642:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788970566.435694:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102355584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970566.435702:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788970566.435727:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970566.435763:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102355584:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788970566.946454:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000020:00000080:1.0:1788970566.946464:0:18650:0:(genops.c:885:class_export_put()) final put ffff8a7d831de000/7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00100000:1.0:1788970566.946486:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000020:00000080:1.0:1788970566.946489:0:18650:0:(genops.c:885:class_export_put()) final put ffff8a7d81a3c800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000020:00000080:2.0:1788970566.946557:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831de000/7365f4d7-b3e1-4126-9092-d6317f98dfcc for lustre-OST0000 00000020:00000080:2.0:1788970566.946597:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81a3c800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 for lustre-OST0000 00000020:00000080:2.0:1788970566.946615:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d831dc000 for lustre-OST0000 00000020:00000080:2.0:1788970566.946620:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebbacb800 for lustre-OST0000 00000001:00100000:3.0:1788970566.947860:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000020:00000080:3.0:1788970566.947867:0:19469:0:(genops.c:885:class_export_put()) final put ffff8a7eb3e10800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00100000:3.0:1788970566.947892:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000020:00000080:3.0:1788970566.947894:0:19469:0:(genops.c:885:class_export_put()) final put ffff8a7d831da800/7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000020:00000080:2.0:1788970566.947943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3e10800/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 for lustre-OST0001 00000020:00000080:2.0:1788970566.947988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831da800/7365f4d7-b3e1-4126-9092-d6317f98dfcc for lustre-OST0001 00000020:00000080:2.0:1788970566.948087:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebdabe000 for lustre-OST0001 00000020:00000080:2.0:1788970566.948092:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d831d8000 for lustre-OST0001 00000020:01000004:3.0:1788970567.078487:0:20720:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788970567.093535:0:20720:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788970567.093600:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.093615:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.093622:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.093629:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.093650:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970567.093667:0:20720:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788970567.093698:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970567.093703:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788970567.093710:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970567.093749:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788970567.093960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102355712:0@lo:39:umount.0 00000100:00100000:2.0:1788970567.094040:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970567.094139:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355712 00000100:00100000:3.0:1788970567.094147:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355712 00000100:00100000:3.0:1788970567.094202:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788970567.094211:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875871102355712:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788970567.094236:0:17151:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fa52 00000100:00080000:3.0:1788970567.094244:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3eb800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788970567.094301:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3648:x1875871102355712:12345-0@lo:39:umount.0 Request processed in 91us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970567.094308:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788970567.094317:0:17151:0:(genops.c:885:class_export_put()) final put ffff8a7eab0ac000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788970567.094338:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eab0ac000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788970567.094368:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970567.094378:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788970567.094404:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3eb800 for lustre-MDT0000 00010000:00010000:0.0:1788970567.094406:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970567.094412:0:19487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.094421:0:19487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970567.094429:0:19487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970567.094435:0:19487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970567.094437:0:19487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788970567.094440:0:19487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788970567.094466:0:19487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.094472:0:19487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970567.094491:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.094498:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9a00/0xc3abfebe76c6fa21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa28 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.094518:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.094519:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.094521:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.094528:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970567.094539:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102355840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970567.094577:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970567.094641:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355840 00000100:00100000:0.0:1788970567.094646:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355840 00000100:00100000:0.0:1788970567.094685:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970567.094693:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+24:3650:x1875871102355840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970567.094704:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970567.094718:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8600/0xc3abfebe76c6fa28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fa21 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.094731:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970567.094762:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c12dceb-6b52-416d-b090-7691eb149d35+23:3650:x1875871102355840:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970567.095125:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788970567.095628:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788970567.095644:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102355712:0@lo:39:umount.0 00000100:00100000:0.0:1788970567.096492:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102355840:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788970567.096841:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970567.096845:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970567.096851:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788970567.098286:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098302:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098309:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098331:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098350:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970567.098357:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098363:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098369:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.098375:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099085:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788970567.099094:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099101:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099106:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099112:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099133:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788970567.099139:0:20720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099145:0:20720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099150:0:20720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099155:0:20720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.099162:0:20720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788970567.099165:0:20720:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788970567.099198:0:20720:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788970567.099202:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788970567.099207:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970567.099213:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00010000:00010000:0.0:1788970567.099215:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:3.0:1788970567.099220:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7eb0c20000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788970567.099226:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788970567.099229:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7d8370c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970567.099242:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7e88b2a000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788970567.099244:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2200 already unused, calling callback (ffffffffc116cc20) 00000020:00080000:3.0:1788970567.099249:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a7eb1459000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:0.0:1788970567.099251:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788970567.099258:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a7d83efa000 7365f4d7-b3e1-4126-9092-d6317f98dfcc 192.168.203.15@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788970567.099265:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a7d81ae8000) has exports, disconnecting them 00000020:00080000:3.0:1788970567.099271:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7eb0c20000), last request at 1788970563 00010000:00010000:0.0:1788970567.099281:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788970567.099287:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc89 00000100:00080000:3.0:1788970567.099306:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c25000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970567.099350:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eb0c20000): rc 0 00000020:00000080:3.0:1788970567.099352:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c20000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788970567.099362:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7d8370c000), last request at 1788970563 00000020:00000080:3.0:1788970567.099365:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fbef 00000100:00080000:3.0:1788970567.099370:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7d82793000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970567.099376:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d8370c000): rc 0 00000020:00000080:3.0:1788970567.099404:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7d8370c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788970567.099409:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7e88b2a000), last request at 1788970500 00000020:00000080:3.0:1788970567.099412:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fb40 00000100:00080000:3.0:1788970567.099416:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b29000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970567.099421:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7e88b2a000): rc 0 00000020:00000080:3.0:1788970567.099423:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7e88b2a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788970567.099427:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a7eb1459000), last request at 1788970500 00000020:00000080:3.0:1788970567.099430:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fae5 00000100:00080000:3.0:1788970567.099432:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788970567.099438:0:20720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:3.0:1788970567.099522:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eb1459000): rc 0 00000004:00000080:3.0:1788970567.099529:0:20720:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa287c106fae0 00000100:00080000:3.0:1788970567.099545:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970567.099550:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788970567.100283:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788970567.100439:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.100463:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8400 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970567.100467:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.100476:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970567.100484:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970567.100490:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970567.100493:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788970567.100495:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788970567.100529:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.100535:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970567.100970:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.100980:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a8400/0xc3abfebe76c6fcba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcc1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.100995:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970567.100999:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101005:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970567.101017:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788970567.101031:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:2.0:1788970567.101032:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970567.101042:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970567.101048:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788970567.101050:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000100:00080000:3.0:1788970567.101052:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1788970567.101053:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788970567.101072:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101079:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970567.101086:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101093:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a800/0xc3abfebe76c6ff1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff22 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101102:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970567.101105:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101112:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970567.101115:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101123:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970567.101138:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970567.101144:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970567.101147:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788970567.101148:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788970567.101160:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101166:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970567.101181:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101188:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3c00/0xc3abfebe76c6f964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f96b expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788970567.101197:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:2.0:1788970567.101199:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970567.101202:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00010000:00010000:2.0:1788970567.101203:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970567.101206:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788970567.101220:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970567.101222:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102355968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970567.101282:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970567.101286:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788970567.101304:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788970567.101312:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788970567.101315:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788970567.101327:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970567.101339:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970567.101347:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102356224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970567.101366:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.101414:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102355968 00000100:00100000:2.0:1788970567.101421:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102355968 00000100:00100000:2.0:1788970567.101455:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356224 00000100:00100000:2.0:1788970567.101457:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356224 00000100:00100000:2.0:1788970567.101470:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970567.101483:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+24:3651:x1875871102355968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970567.101495:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970567.101507:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c6fcc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fcba expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.101518:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970567.101547:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+23:3651:x1875871102355968:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970567.101553:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:00010000:0.0:1788970567.101785:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970567.101793:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970567.101795:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788970567.101797:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788970567.101811:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.101817:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970567.101825:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.101832:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2200/0xc3abfebe76c6f972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6f979 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970567.101841:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.101843:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.101845:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970567.101859:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970567.102308:0:20720:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788970567.102321:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788970567.102368:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a7d81ae8000) has no exports 00000100:00100000:2.0:1788970567.103446:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970567.103460:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+22:3651:x1875871102356224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970567.103476:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970567.103493:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83025400/0xc3abfebe76c6ff22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6ff1b expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970567.103506:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970567.103557:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+21:3651:x1875871102356224:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970567.104023:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970567.104069:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102356224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970567.104079:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102355968:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788970567.104110:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c20000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788970567.104165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d8370c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788970567.104186:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b2a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788970567.104211:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0c25000 for lustre-MDT0000 00000020:00000080:2.0:1788970567.104215:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d82793000 for lustre-MDT0000 00000020:00000080:2.0:1788970567.104233:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7e88b29000 for lustre-MDT0000 00000100:00100000:2.0:1788970567.104251:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102356352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970567.104705:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.104753:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970567.104755:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356352 00000100:00100000:2.0:1788970567.104762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102356608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970567.104764:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356352 00000100:00100000:2.0:1788970567.104794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.104837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356096:0@lo:39:umount.0 00000100:00100000:2.0:1788970567.104864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.104886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356480:0@lo:9:umount.0 00000100:00100000:2.0:1788970567.104907:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.104936:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356736:0@lo:9:umount.0 00000100:00100000:2.0:1788970567.104956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.104985:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356096 00000100:00100000:2.0:1788970567.104989:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356096 00000100:00100000:2.0:1788970567.105027:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788970567.105035:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102356096:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788970567.105065:0:17155:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fb6a 00000100:00080000:2.0:1788970567.105074:0:17155:0:(import.c:65:import_set_state_nolock()) ffff8a7eaec85000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970567.105096:0:17155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788970567.105204:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3648:x1875871102356096:12345-0@lo:39:umount.0 Request processed in 170us (339us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788970567.105210:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788970567.105228:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356480 00000100:00100000:2.0:1788970567.105231:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356480 00000100:00100000:2.0:1788970567.105262:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356736 00000100:00100000:2.0:1788970567.105265:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356736 00000100:00100000:2.0:1788970567.105283:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970567.105499:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102356480:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788970567.105514:0:18656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fcc8 00000100:00080000:2.0:1788970567.105519:0:18656:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa731000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970567.105552:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788970567.105649:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3648:x1875871102356480:12345-0@lo:9:umount.0 Request processed in 152us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970567.105656:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970567.105668:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970567.105675:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875871102356736:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788970567.105685:0:18656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fccf 00000100:00080000:2.0:1788970567.105691:0:18656:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c23000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788970567.105714:0:18656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788970567.105792:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3648:x1875871102356736:12345-0@lo:9:umount.0 Request processed in 117us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970567.105798:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788970567.105818:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970567.105825:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970567.105828:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788970567.105839:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970567.105875:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356608 00000100:00100000:3.0:1788970567.105880:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356608 00000100:00100000:3.0:1788970567.105905:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970567.105913:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+22:3649:x1875871102356352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970567.105923:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970567.105939:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8a00/0xc3abfebe76c6f96b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6f964 expref: 22 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.105964:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970567.105999:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+21:3649:x1875871102356352:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970567.106005:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970567.106029:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970567.106035:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+20:3649:x1875871102356608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788970567.106043:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970567.106053:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8200/0xc3abfebe76c6f979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6f972 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970567.106062:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970567.106095:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c12dceb-6b52-416d-b090-7691eb149d35+19:3649:x1875871102356608:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970567.106102:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788970567.106534:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788970567.106543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356096:0@lo:39:umount.0 00000100:00080000:3.0:1788970567.106557:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb145c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788970567.106582:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788970567.106585:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970567.106588:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356480:0@lo:9:umount.0 00000100:00080000:3.0:1788970567.106600:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788970567.106608:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788970567.106610:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970567.106613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102356736:0@lo:9:umount.0 00010000:00010000:1.0:1788970567.110952:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970567.111265:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102356608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970567.111280:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102356352:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788970567.118035:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a7d81ae8000) has no exports 00000020:00000080:1.0:1788970567.190935:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9bf 00000020:00000080:1.0:1788970567.190952:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb145a800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788970567.190978:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788970567.191019:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb145a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788970567.192762:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970567.192778:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970567.192783:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a7eb3dc0000) has no exports 00000020:00000080:0.0:1788970567.193318:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9b8 00000020:00000080:0.0:1788970567.193328:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7e957c4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788970567.193427:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970567.193436:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788970567.193446:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e957c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788970567.193456:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eab0af000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788970567.193459:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eab0af000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788970567.193469:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788970567.395376:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970567.452939:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788970567.452963:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102356864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970567.453042:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970567.453337:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356864 00000100:00100000:2.0:1788970567.453346:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356864 00000100:00100000:2.0:1788970567.453408:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788970567.453418:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1875871102356864:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788970567.453427:0:17156:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788970567.453507:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1875871102356864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (464us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788970567.453515:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:02020000:3.0:1788970567.453653:0:3652:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788970567.461682:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788970567.461693:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788970567.461698:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788970567.486681:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970567.486693:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:3.0:1788970567.486708:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7e88b2f800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970567.486752:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830eb0c0 x1875871102356992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970567.486837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102356992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788970567.486901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970567.487135:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102356992 00000100:00100000:1.0:1788970567.487144:0:17890:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102356992 00000100:00100000:1.0:1788970567.487189:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788970567.487197:0:17890:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102356992:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788970567.487215:0:17890:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788970567.493673:0:17890:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102356992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 6464us (6761us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970567.493687:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788970567.494322:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970567.494330:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970567.494334:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102356992:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1788970568.412536:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970568.988837:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102357120:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788970568.988905:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970568.988910:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970568.988914:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970568.988920:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1788970568.988925:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788970568.988930:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788970568.988939:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7e88b2f800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970568.988961:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf621c0 x1875871102357376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970568.989025:0:20378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357120 00000100:00100000:0.0:1788970568.989034:0:20378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357120 00000100:00080000:2.0:1788970568.989069:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970568.989087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102357248:0@lo:400:kworker.0 00000100:00100000:0.0:1788970568.989094:0:20378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970568.989105:0:20378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102357120:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970568.989127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788970568.989137:0:20378:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970568.989167:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970568.989176:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102357504:0@lo:400:kworker.0 00000100:00100000:2.0:1788970568.989209:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970568.989240:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357248 00000100:00100000:2.0:1788970568.989244:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357248 00000100:00100000:2.0:1788970568.989277:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788970568.989283:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:3649:x1875871102357248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970568.989333:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3c12dceb-6b52-416d-b090-7691eb149d35+19:3649:x1875871102357248:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970568.989341:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788970568.989407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3c12dceb-6b52-416d-b090-7691eb149d35:3649:1875871102357248:0@lo:400:kworker.0 00000100:00100000:2.0:1788970568.989448:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102357632:0@lo:400:kworker.0 00000100:00100000:2.0:1788970568.989476:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970568.990609:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357504 00000100:00100000:3.0:1788970568.990621:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357504 00000100:00100000:0.0:1788970568.991878:0:20378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102357120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2769us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970568.991893:0:20378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970568.992667:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102357376:0@lo:38:kworker.0 00000100:00100000:0.0:1788970568.992727:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970568.992772:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357376 00000100:00100000:0.0:1788970568.992778:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357376 00000100:00100000:0.0:1788970568.992889:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788970568.992896:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102357376:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788970568.992913:0:17155:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788970568.992949:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102357376:12345-0@lo:38:kworker.0 Request processed in 53us (222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970568.992956:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788970568.993023:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970568.993029:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970568.993032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102357376:0@lo:38:kworker.0 00000100:00100000:3.0:1788970568.993241:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970568.993254:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102357504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970568.993296:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102357504:12345-0@lo:400:kworker.0 Request processed in 47us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970568.993797:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788970568.993848:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ddf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102357120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970568.993870:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102357760:0@lo:400:kworker.0 00000100:00100000:3.0:1788970568.993901:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970568.993927:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357632 00000100:00100000:3.0:1788970568.993933:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357632 00000100:00100000:3.0:1788970568.993954:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357760 00000100:00100000:3.0:1788970568.993957:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357760 00000100:00100000:3.0:1788970568.993972:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788970568.993978:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875871102357632:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788970568.993984:0:19483:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788970568.994025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102358144:0@lo:400:kworker.0 00000100:00100000:3.0:1788970568.994041:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1875871102357632:12345-0@lo:400:kworker.0 Request processed in 61us (4562us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970568.994048:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788970568.994064:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970568.994069:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970568.994073:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875871102357760:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788970568.994079:0:19483:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1788970568.994100:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788970568.994106:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788970568.994112:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788970568.994113:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3652:x1875871102357760:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788970568.994121:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788970568.994127:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970568.994135:0:3651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 519 00000100:00100000:3.0:1788970568.994145:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358144 00000100:00080000:2.0:1788970568.994146:0:3651:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7eaa732800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970568.994151:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358144 00000100:00100000:2.0:1788970568.994174:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7e8949d2c0 x1875871102358272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970568.994187:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788970568.994196:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102358144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970568.994201:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102357632:0@lo:400:kworker.0 00000100:00080000:2.0:1788970568.994232:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970568.994238:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970568.994243:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102358144:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970568.994250:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:2.0:1788970568.994263:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebdb6cf00 x1875871102358144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970568.994274:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102358144:0@lo:400:kworker.0 00000100:00080000:3.0:1788970568.994288:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788970568.994292:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788970568.994295:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788970568.994299:0:3652:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970568.994311:0:3652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 533 00000100:00080000:3.0:1788970568.994317:0:3652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7ebf3b0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970568.994332:0:3652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830e9a40 x1875871102358400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970568.994343:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102357760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.996933:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102358016:0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.997022:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970568.997133:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970568.997263:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102357888:0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.997304:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970568.997304:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102357504:0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.997364:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358016 00000100:00100000:1.0:1788970568.997371:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358016 00000100:00100000:1.0:1788970568.997421:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102357888 00000100:00100000:1.0:1788970568.997425:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102357888 00000100:00100000:0.0:1788970568.997427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102358272:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788970568.997464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970568.997470:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358272 00000100:00100000:1.0:1788970568.997474:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358272 00000100:00100000:0.0:1788970568.997481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102358400:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788970568.997491:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970568.997505:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970568.997542:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358400 00000100:00100000:0.0:1788970568.997546:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358400 00000100:00100000:1.0:1788970568.997603:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102357888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.997659:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102357888:12345-0@lo:400:kworker.0 Request processed in 60us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970568.998302:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970568.998316:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970568.998348:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875871102358016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970568.998352:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000020:00080000:0.0:1788970568.998359:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788970568.998362:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102358272:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788970568.998401:0:19483:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788970568.998425:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875871102358016:12345-0@lo:400:kworker.0 Request processed in 76us (1402us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788970568.998432:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788970568.998450:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788970568.998454:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102358272:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 91us (987us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970568.998458:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102358400:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788970568.998468:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:02000000:0.0:1788970568.998471:0:17151:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788970568.998503:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102358400:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47us (1000us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970568.998510:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788970568.998530:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970568.998569:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970568.998576:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00080000:1.0:1788970568.998577:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebdb6c3c0 x1875871102357888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970568.998581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102358272:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788970568.998592:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102357888:0@lo:400:kworker.0 00000100:00080000:0.0:1788970568.998611:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970568.998616:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1788970568.998621:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788970568.998621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102358400:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788970568.998628:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788970568.998633:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788970568.998639:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970568.998643:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 548 00000100:00080000:1.0:1788970568.998652:0:3650:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7eb0c22800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970568.998684:0:3650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6f840 x1875871102358528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970568.998711:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788970568.998962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102358528:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788970568.999004:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970568.999087:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358528 00000100:00100000:1.0:1788970568.999093:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358528 00000100:00100000:0.0:1788970568.999153:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970568.999158:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102358528:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788970568.999167:0:17152:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788970568.999199:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102358528:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 39us (204us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970568.999205:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788970568.999228:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970568.999232:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970568.999235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102358528:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788970569.437665:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788970569.504717:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788970569.504732:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788970569.504737:0:17882:0:(genops.c:885:class_export_put()) final put ffff8a7eaec80000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788970569.504813:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00080000:2.0:1788970569.504818:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788970569.504820:0:17882:0:(genops.c:885:class_export_put()) final put ffff8a7d83efc000/7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000020:00000080:1.0:1788970569.509267:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec80000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788970569.509433:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaec85000 for lustre-MDT0001 00000001:00100000:0.0:1788970569.510462:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788970569.510468:0:17130:0:(genops.c:885:class_export_put()) final put ffff8a7eb1459000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788970569.510491:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000001:00080000:0.0:1788970569.510499:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1788970569.510502:0:17130:0:(genops.c:885:class_export_put()) final put ffff8a7d83efa000/7365f4d7-b3e1-4126-9092-d6317f98dfcc 00000020:00000080:1.0:1788970569.510612:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1459000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788970569.510656:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83efa000/7365f4d7-b3e1-4126-9092-d6317f98dfcc for lustre-MDT0000 00000020:00000080:1.0:1788970569.510684:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb145c800 for lustre-MDT0000 00000020:00000080:1.0:1788970569.510688:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83efe000 for lustre-MDT0000 00000020:00000080:3.0:1788970569.510947:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83efc000/7365f4d7-b3e1-4126-9092-d6317f98dfcc for lustre-MDT0001 00000020:00000080:3.0:1788970569.510987:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83eff800 for lustre-MDT0001 00000001:00100000:2.0:1788970569.511030:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000001:00080000:2.0:1788970569.511037:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788970569.511040:0:17882:0:(genops.c:885:class_export_put()) final put ffff8a7d8368c000/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 00000020:00000080:3.0:1788970569.511101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d8368c000/76f5674c-81e4-444b-a7b0-2ac4d1e4da63 for lustre-MDT0001 00000020:00000080:3.0:1788970569.511133:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d8368d800 for lustre-MDT0001 00010000:00010000:0.0:1788970570.462656:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970571.484786:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970571.548844:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102358656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970571.548925:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970571.549048:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358656 00000100:00100000:1.0:1788970571.549056:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358656 00000100:00100000:1.0:1788970571.549125:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788970571.549136:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102358656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970571.549167:0:18657:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788970571.549351:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970571.549427:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102358656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 293us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970571.549489:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102358656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788970571.549535:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:3.0:1788970572.317072:0:17908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970572.508633:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970572.575531:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970572.575541:0:19469:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c24800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788970572.576840:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970572.576846:0:18650:0:(genops.c:885:class_export_put()) final put ffff8a7eaa731800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788970572.576960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788970572.577022:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0c23000 for lustre-OST0001 00000020:00000080:3.0:1788970572.578189:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaa731800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788970572.578356:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaa731000 for lustre-OST0000 00000020:01000000:0.0:1788970573.276523:0:20720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e8fc88f00 - data ffff8a7eb10296c0/ffff8a7d84565c00 00000020:01000000:0.0:1788970573.276900:0:20720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e8fc88000 - data ffff8a7eb1028798/ffff8a7ebda31c00 00000001:00000004:0.0:1788970573.289649:0:20720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:3.0:1788970573.353829:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970573.353838:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970573.353851:0:20720:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a7d830e8b40 x1875871102356096/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788970577 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970573.353873:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788970573.357978:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788970573.357989:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788970573.358029:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970573.358034:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788970573.367950:0:17174:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788970573.367957:0:17174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788970573.367991:0:17174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788970573.368948:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788970573.368954:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788970573.368983:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788970573.368986:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788970573.372951:0:17176:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788970573.372959:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788970573.372983:0:17176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788970573.381471:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f987 00000020:00000080:1.0:1788970573.381485:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1455000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788970573.381567:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1455000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788970573.386579:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f99c 00000020:00000080:1.0:1788970573.386600:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1457000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788970573.386643:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788970573.386648:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970573.386656:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788970573.386660:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a7d81aecd40) has no exports 00000004:01000000:1.0:1788970573.386815:0:20720:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788970573.386822:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9fe 00000020:00000080:1.0:1788970573.386827:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eaef54000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970573.387347:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1457000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788970573.387519:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788970573.387523:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970573.387529:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970573.387533:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a7d833919c0) has no exports 00000020:00000080:1.0:1788970573.387539:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9f7 00000020:00000080:1.0:1788970573.387543:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970573.387832:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaef54000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788970573.388463:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788970573.388469:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788970573.388474:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788970573.388479:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970573.388482:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970573.389315:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970573.389970:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788970573.390017:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970573.390028:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970573.390033:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb145f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788970573.390036:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb145f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788970573.390041:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970573.390176:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9e9 00000020:00000080:1.0:1788970573.390183:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1459800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788970573.390194:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788970573.390197:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970573.390202:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970573.390205:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a7ebd8ecd40) has no exports 00000020:00000080:3.0:1788970573.390283:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1459800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788970573.390305:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9e2 00000020:00000080:1.0:1788970573.390310:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb145e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970573.390528:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb145e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788970573.391036:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788970573.391041:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788970573.391045:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788970573.391050:0:20720:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788970573.391052:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970573.391127:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970573.391133:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788970573.391144:0:20720:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788970573.391149:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9d4 00000020:00000080:1.0:1788970573.391154:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb145f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970573.391597:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb145c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788970573.391605:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7eb1458800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970573.391607:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1458800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788970573.391612:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788970573.391718:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788970573.391721:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970573.391726:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788970573.391729:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff8a7d83394d40) has no exports 00000020:00000080:1.0:1788970573.391733:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9cd 00000020:00000080:1.0:1788970573.391738:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788970573.393036:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb145f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788970573.393059:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788970573.395099:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788970573.395108:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788970573.395112:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970573.395127:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970573.395178:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.395188:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788970573.395301:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b3800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788970573.395311:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7ebf3b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788970573.395315:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf3b7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788970573.395321:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970573.395481:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.395485:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970573.395488:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1453000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788970573.395490:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1453000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788970573.395498:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788970573.395568:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9a3 00000020:00000080:0.0:1788970573.395575:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1450800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788970573.395588:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788970573.395592:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970573.395596:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788970573.395600:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a7d81aeb380) has no exports 00000020:00000080:0.0:1788970573.395618:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.395620:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788970573.395624:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f9aa 00000020:00000080:0.0:1788970573.395627:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1454800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788970573.395634:0:20720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7e92fc7000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788970573.395637:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7e92fc7000 3 00000020:01000004:0.0:1788970573.395640:0:20720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7e92fc7000 from lustre-MDT0000 00000020:00000080:0.0:1788970573.395657:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.395660:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788970573.395662:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eb1456800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788970573.395664:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1456800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788970573.395681:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788970573.395711:0:20720:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788970573.395715:0:20720:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788970573.395718:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788970573.395721:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970573.395724:0:20720:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970573.395730:0:20720:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a7d83fcb000 3c12dceb-6b52-416d-b090-7691eb149d35 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970573.395735:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a7d81ae99c0) has exports, disconnecting them 00000020:00080000:0.0:1788970573.395740:0:20720:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a7d83fcb000), last request at 1788970487 00000020:00000080:0.0:1788970573.395753:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f94f 00000020:00010000:0.0:1788970573.395757:0:20720:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a7d83fcb000: total 2 00000100:00080000:0.0:1788970573.395760:0:20720:0:(import.c:65:import_set_state_nolock()) ffff8a7d83fcb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788970573.395772:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d83fcb000): rc 0 00000020:00080000:0.0:1788970573.395775:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a7d81ae99c0) has no exports 00000020:00010000:0.0:1788970573.395785:0:17139:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a7d83fcb000: total 2 00010000:00010000:0.0:1788970573.395788:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970573.395809:0:17139:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a7d83fcb000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788970573.395835:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eae012c00/0xc3abfebe76c6fbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fba9 expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.395851:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c6fef8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fef1 expref: 13 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788970573.395935:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1450800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788970573.395939:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7eb1450000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788970573.395941:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1450000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788970573.395945:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788970573.395986:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1454800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788970573.396076:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9400/0xc3abfebe76c6fa6e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fa67 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396089:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df2400/0xc3abfebe76c6fc4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fc43 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396098:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654400/0xc3abfebe76c6fbda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fbd3 expref: 10 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396182:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3e00/0xc3abfebe76c6ff06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6feff expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396193:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c6fb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fb24 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396203:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c6fa7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fa75 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396291:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c6ff14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6ff0d expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396303:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c6fa8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fa83 expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396312:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eb59a9c00/0xc3abfebe76c6f95d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6f956 expref: 4 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396321:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655000/0xc3abfebe76c6fc74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fc6d expref: 3 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396331:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c6fcb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3abfebe76c6fcac expref: 2 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970573.396341:0:17139:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a7d83fcb000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788970573.396356:0:17139:0:(genops.c:885:class_export_put()) final put ffff8a7d83fcb000/3c12dceb-6b52-416d-b090-7691eb149d35 00010000:00010000:0.0:1788970573.396477:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970573.396479:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970573.396481:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970573.396544:0:17143:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a7d835dc400:17143] 0 exiting: rc = 1 00000100:00100000:0.0:1788970573.397804:0:17145:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a7d81a61200:17145] 2 exiting: rc = 0 00000020:00000080:3.0:1788970573.398824:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83fcb000/3c12dceb-6b52-416d-b090-7691eb149d35 for MGS 00000020:00000080:3.0:1788970573.400172:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83fcb800 for MGS 00000100:00100000:3.0:1788970573.400520:0:17144:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a7eaef42600:17144] 1 exiting: rc = 0 00000100:00100000:0.0:1788970573.400602:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400613:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400618:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400627:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400632:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400638:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400644:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400650:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400656:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400685:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400694:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400700:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400707:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400713:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400718:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400728:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400733:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400739:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400745:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400751:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400757:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400762:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400767:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400772:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400777:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400782:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400788:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400795:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400800:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400806:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400811:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400817:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400822:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.400841:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402514:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402520:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402526:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402533:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402539:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402544:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402552:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402558:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402680:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402685:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402783:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402791:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402796:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402804:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402809:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402815:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402820:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402825:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402830:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402835:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.402844:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403802:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403816:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403821:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403827:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403832:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.403838:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.404180:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.404193:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970573.404201:0:20720:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788970573.410174:0:20720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d82528de0 - data ffff8a7eb11140d8/ffff8a7d830b1000 00000020:01000000:0.0:1788970573.410302:0:20720:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e91ff4cc0 - data ffff8a7eb102bd80/ffff8a7eaec20c00 00000020:00000080:0.0:1788970573.420745:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f933 00000020:00000080:0.0:1788970573.420770:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7d83fce000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788970573.420824:0:20720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7e92fc7000 from MGS, refs=2 00000020:01000004:0.0:1788970573.420828:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7e92fc7000 2 00000020:01000004:0.0:1788970573.420832:0:20720:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7e92fc7000 from MGS 00000020:00000080:0.0:1788970573.421314:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.421323:0:20720:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788970573.421326:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7d83fc8800/MGS 00000020:00000080:0.0:1788970573.421329:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83fc8800/MGS for MGS 00000020:01000000:0.0:1788970573.421337:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788970573.421491:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788970573.421496:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970573.421502:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970573.421508:0:20720:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a7d831e1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970573.421515:0:20720:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8a7ebd8e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788970573.421520:0:20720:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a7d831e1800), last request at 1788970488 00000020:00000080:0.0:1788970573.421525:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fa36 00000020:00080000:0.0:1788970573.421536:0:20720:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d831e1800): rc 0 00000020:00000080:0.0:1788970573.421539:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7d831e1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788970573.423650:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83fce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970573.426107:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831e1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788970573.475467:0:20720:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788970573.475475:0:20720:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970573.475479:0:20720:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970573.475487:0:20720:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970573.475524:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb3da5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788970573.475718:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970573.475727:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788970573.475732:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7eab0a9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788970573.475736:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eab0a9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788970573.475742:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788970573.475821:0:20720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7e92fc7000 1 00000020:00000080:3.0:1788970573.475827:0:20720:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f925 00000020:00000080:3.0:1788970573.475833:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7d83fca800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788970573.475851:0:20720:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788970573.475860:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83fca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788970573.475869:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970573.475874:0:20720:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970573.475877:0:20720:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a7eb3dc19c0) has no exports 00000020:00000080:0.0:1788970573.521151:0:20720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970573.521163:0:20720:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788970573.521168:0:20720:0:(genops.c:885:class_export_put()) final put ffff8a7e92fc7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788970573.521173:0:20720:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e92fc7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788970573.521179:0:20720:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788970573.521290:0:20720:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7e92fc5000 00000020:02000400:0.0:1788970573.521346:0:20720:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788970573.537503:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970574.108664:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102358784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970574.108750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970574.109355:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102358912:0@lo:400:kworker.0 00000400:00000100:1.0:1788970574.109402:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102358912 offset 0 length 224: 4 00000100:00080000:0.0:1788970574.112275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970574.112284:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788970574.112288:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970574.112295:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788970574.112301:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970574.112323:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7e88b2f800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970574.112359:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf621c0 x1875871102359040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970574.112621:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102359168:0@lo:400:kworker.0 00000100:00080000:0.0:1788970574.112854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788970574.112938:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970574.113003:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359168 00000100:00100000:2.0:1788970574.113010:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359168 00000100:00100000:2.0:1788970574.113060:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788970574.113069:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102359168:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788970574.113262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788970574.113265:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970574.113269:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788970574.113272:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788970574.113278:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7eaa732800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970574.113297:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d822d7c00 x1875871102359296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970574.113307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970574.113311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788970574.113312:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970574.113316:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788970574.113318:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788970574.113323:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7ebf3b0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970574.113334:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee6d00 x1875871102359424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970574.113553:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788970574.115347:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970574.115352:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788970574.115355:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970574.115360:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 588 00000100:00080000:0.0:1788970574.115365:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788970574.115397:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7eb0c22800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970574.115419:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ea1f2ed00 x1875871102359680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970574.115479:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102358784 00000100:00100000:0.0:1788970574.115486:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102358784 00000100:00100000:2.0:1788970574.115969:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102359168:12345-0@lo:400:kworker.0 Request processed in 2891us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970574.115980:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970574.116312:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970574.116322:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102358784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970574.116344:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788970574.116378:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102358784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (7628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970574.116404:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970574.116429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102359040:0@lo:38:kworker.0 00000100:00100000:0.0:1788970574.116464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970574.116487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102359296:0@lo:38:kworker.0 00000100:00080000:3.0:1788970574.116763:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970574.116779:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970574.116797:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102359424:0@lo:38:kworker.0 00000100:00100000:3.0:1788970574.116799:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102359168:0@lo:400:kworker.0 00000100:00100000:0.0:1788970574.116816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970574.116817:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970574.116824:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788970574.116828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102359680:0@lo:38:kworker.0 00000100:00100000:0.0:1788970574.116847:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970574.116873:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970574.116893:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970574.116895:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359296 00000100:00100000:3.0:1788970574.116899:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359296 00000100:00100000:0.0:1788970574.116900:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102359808:0@lo:400:kworker.0 00000100:00100000:3.0:1788970574.116915:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359424 00000100:00100000:3.0:1788970574.116917:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359424 00000100:00100000:0.0:1788970574.116921:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970574.116925:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359680 00000100:00100000:3.0:1788970574.116927:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359680 00000100:00100000:3.0:1788970574.116933:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359552 00000100:00100000:3.0:1788970574.116935:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359552 00000100:00100000:0.0:1788970574.116939:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359040 00000100:00100000:0.0:1788970574.116941:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359040 00000100:00100000:3.0:1788970574.116954:0:19483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359808 00000100:00100000:3.0:1788970574.116967:0:19483:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359808 00000100:00100000:0.0:1788970574.116967:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788970574.116972:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102359040:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788970574.116982:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788970574.116987:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102359552:12345-0@lo:400:kworker.0 00010000:00020000:0.0:1788970574.116999:0:17155:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970574.117019:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102359552:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970574.117025:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788970574.117037:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970574.117042:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102359808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970574.117069:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875871102359808:12345-0@lo:400:kworker.0 Request processed in 27us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970574.117081:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788970574.117093:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788970574.117096:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788970574.117106:0:19483:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970574.117138:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e93590b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359296:12345-0@lo:38:kworker.0 Request processed in 40us (359us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970574.117144:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788970574.117154:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970574.117157:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788970574.117165:0:19483:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970574.117186:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359424:12345-0@lo:38:kworker.0 Request processed in 28us (369us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970574.117192:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970574.117202:0:19483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788970574.117206:0:19483:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359680:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788970574.117214:0:19483:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970574.117235:0:19483:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875871102359680:12345-0@lo:38:kworker.0 Request processed in 27us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970574.117240:0:19483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788970574.117252:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788970574.117273:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a7d836b0b40 x1875871102359808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970574.117283:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3650:1875871102359808:0@lo:400:kworker.0 00000100:00080000:3.0:1788970574.117305:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970574.117316:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788970574.117319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102359296:0@lo:38:kworker.0 00000100:00080000:3.0:1788970574.117329:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970574.117332:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788970574.117334:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102359424:0@lo:38:kworker.0 00000100:00080000:3.0:1788970574.117340:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970574.117343:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788970574.117345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102359680:0@lo:38:kworker.0 00010000:00080000:3.0:1788970574.117371:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a7d83ee4f00 x1875871102359552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970574.117406:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788970574.123919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102358784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970574.146973:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102359040:12345-0@lo:38:kworker.0 Request processed in 29984us (30493us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970574.146989:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788970574.147019:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970574.147026:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970574.147031:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102359040:0@lo:38:kworker.0 00010000:00010000:1.0:1788970574.562908:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970575.582606:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788970576.488287:0:20921:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788970576.497185:0:20921:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788970576.497240:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.497255:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.497263:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.497270:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.497293:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970576.497299:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788970576.497350:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970576.497354:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788970576.497361:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970576.497367:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7eaa732800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788970576.497372:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970576.497373:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788970576.497376:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788970576.498221:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970576.498230:0:19487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970576.498239:0:19487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:2.0:1788970576.498242:0:19487:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970576.498250:0:19487:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970576.498256:0:19487:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970576.498273:0:19487:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970576.498275:0:19487:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788970576.498278:0:19487:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788970576.498318:0:19487:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970576.498324:0:19487:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788970576.498347:0:19487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970576.498353:0:19487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654a00/0xc3abfebe76c6fb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fb2b expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970576.498367:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970576.498368:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970576.498370:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970576.498405:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102359936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970576.499245:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970576.499328:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102359936 00000100:00100000:2.0:1788970576.499337:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102359936 00000100:00100000:2.0:1788970576.499373:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970576.499402:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875871102359936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788970576.499409:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970576 with bad export cookie 14099643152403462479 00010000:00010000:3.0:1788970576.500074:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500085:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500092:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500099:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500119:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970576.500124:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500131:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500138:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500144:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500423:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788970576.500432:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500439:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500446:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.500452:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502378:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788970576.502404:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502405:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970576.502415:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502417:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3600 already unused, calling callback (ffffffffc116cc20) 00010000:00010000:1.0:1788970576.502428:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970576.502429:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970576.502437:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502442:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502448:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970576.502453:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970576.502460:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788970576.502463:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:00010000:1.0:1788970576.502478:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970576.502487:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970576.502490:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788970576.502493:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788970576.502520:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502520:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502536:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970576.502537:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970576.502563:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502563:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502582:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654800/0xc3abfebe76c6fcac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fcb3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502583:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3600/0xc3abfebe76c6fa83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa8a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502615:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970576.502620:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970576.502621:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970576.502623:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970576.502627:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970576.502632:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970576.502634:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502642:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970576.502648:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970576.502653:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102360064:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788970576.502666:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788970576.502669:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788970576.502685:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502691:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970576.502710:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.502720:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970576.502720:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970576.502724:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970576.502726:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970576.502742:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102360192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970576.502790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970576.502802:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102360320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970576.502824:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970576.502884:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788970576.502892:0:20921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654200/0xc3abfebe76c6ff0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6ff14 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970576.502904:0:20921:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788970576.502911:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.502919:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.502926:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.502932:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970576.503132:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788970576.503136:0:20921:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788970576.503139:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788970576.503171:0:20921:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788970576.503175:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788970576.503180:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970576.503185:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788970576.503189:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a7ebb89d800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970576.503196:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a7ebbacc800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970576.503201:0:20921:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8a7e8828cd40) has exports, disconnecting them 00000020:00080000:3.0:1788970576.503205:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a7ebb89d800), last request at 1788970574 00000020:00000080:3.0:1788970576.503212:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc9e 00000100:00080000:3.0:1788970576.503229:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbac9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970576.503274:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7ebb89d800): rc 0 00000020:00000080:3.0:1788970576.503277:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7ebb89d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788970576.503287:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a7ebbacc800), last request at 1788970574 00000020:00000080:3.0:1788970576.503290:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc04 00000100:00080000:3.0:1788970576.503296:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7ebbac9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788970576.503302:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7ebbacc800): rc 0 00000020:00000080:3.0:1788970576.503304:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7ebbacc800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788970576.503310:0:20921:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa287c106fae0 00000100:00080000:3.0:1788970576.503329:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970576.503336:0:20921:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a7ebf374000 x1875871102356864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788970583 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970576.503350:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788970576.504077:0:17136:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00080000:3.0:1788970576.504523:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970576.504530:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7e88b2f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:1.0:1788970576.504531:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebb89d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788970576.504582:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbacc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788970576.504602:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebbac9800 for lustre-MDT0001 00000020:00000080:1.0:1788970576.504609:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebbac9000 for lustre-MDT0001 00000100:00100000:1.0:1788970576.504630:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970576.504650:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102356864:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788970576.504679:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788970576.504683:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788970576.504697:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788970576.504775:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788970576.504792:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788970576.504805:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788970576.504807:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788970576.504815:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788970576.504827:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970576.504834:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.504844:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970576.504855:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.504864:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970576.504872:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970576.504879:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970576.504881:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788970576.504885:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1788970576.504888:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788970576.504899:0:20921:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788970576.504910:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.504917:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970576.504932:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.504950:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2c00/0xc3abfebe76c6fa75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3abfebe76c6fa7c expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970576.504964:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970576.504966:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970576.504968:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970576.505124:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102360704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970576.505176:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970576.505590:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788970576.505867:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a7e8828cd40) has no exports 00000100:00100000:0.0:1788970576.506250:0:17136:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788970576.506435:0:17137:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788970576.506445:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360064 00000100:00100000:3.0:1788970576.506452:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360064 00000100:00100000:3.0:1788970576.506475:0:17137:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788970576.506481:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360320 00000100:00100000:3.0:1788970576.506484:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360320 00000100:00100000:3.0:1788970576.506496:0:17137:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788970576.506501:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360192 00000100:00100000:3.0:1788970576.506504:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360192 00000100:00100000:3.0:1788970576.506513:0:17137:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788970576.506570:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102360448:0@lo:9:umount.0 00000100:00100000:0.0:1788970576.506625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970576.506661:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360704 00000100:00100000:3.0:1788970576.506665:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360704 00000100:00100000:0.0:1788970576.506688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102360576:0@lo:9:umount.0 00010000:00010000:3.0:1788970576.506726:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970576.506864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970576.506930:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360448 00000100:00100000:0.0:1788970576.506934:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360448 00000100:00100000:0.0:1788970576.507108:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102360576 00000100:00100000:0.0:1788970576.507112:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102360576 00000100:00080000:3.0:1788970576.507141:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788970576.507149:0:17146:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970576.507251:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970576.507261:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875871102360448:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788970576.507283:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc2e 00000100:00080000:0.0:1788970576.507291:0:18654:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0ea7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788970576.507355:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788970576.507510:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1875871102360448:12345-0@lo:9:umount.0 Request processed in 251us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970576.507518:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970576.507533:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788970576.507538:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875871102360576:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788970576.507549:0:18654:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fcd6 00000100:00080000:0.0:1788970576.507564:0:18654:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c26000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788970576.507617:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788970576.507687:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788970576.507881:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3648:x1875871102360576:12345-0@lo:9:umount.0 Request processed in 341us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970576.507887:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788970576.507927:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7eb3da2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788970576.507948:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788970576.507950:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970576.508029:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102360448:0@lo:9:umount.0 00000100:00080000:0.0:1788970576.508045:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf505000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788970576.508054:0:3648:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788970576.508055:0:3648:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788970576.508058:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102360576:0@lo:9:umount.0 00000100:00100000:0.0:1788970576.508152:0:20922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788970576.508158:0:20922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1875871102360064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788970576.508164:0:20922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970576 with bad export cookie 14099643152403462479 00000100:00100000:0.0:1788970576.508199:0:20922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1875871102360064:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (5482us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788970576.508205:0:20922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788970576.508227:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788970576.508231:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788970576.508234:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788970576.508263:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970576.513500:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875871102359936:12345-0@lo:103:ldlm_bl.0 Request processed in 14114us (14252us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788970576.513513:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788970576.513565:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788970576.514583:0:20922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970576.514593:0:20922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875871102360320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788970576.514617:0:20922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970576 with bad export cookie 14099643152403462479 00000100:00100000:1.0:1788970576.514675:0:20922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875871102360320:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (11849us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788970576.514683:0:20922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970576.514709:0:20922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970576.514714:0:20922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1875871102360192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788970576.514719:0:20922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970576 with bad export cookie 14099643152403462479 00000100:00100000:1.0:1788970576.514837:0:20922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1875871102360192:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (10208us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788970576.514844:0:20922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788970576.514887:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788970576.514895:0:20922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970576.514900:0:20922:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875871102360704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788970576.514905:0:20922:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788970576 with bad export cookie 14099643152403462479 00000100:00100000:1.0:1788970576.514933:0:20922:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875871102360704:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (9757us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788970576.514953:0:20922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788970576.525639:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.115@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788970576.525645:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788970576.525655:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebcf603c0 x1875871102358912/t0(0) o400->MGC192.168.203.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788970590 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970576.525665:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7e8949d2c0 x1875871102359936/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970592 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970576.525686:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebba8ed00 x1875871102360064/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970592 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970576.525693:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6c3c0 x1875871102360192/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970592 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970576.525698:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6f480 x1875871102360320/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970592 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970576.525703:0:3651:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6fc00 x1875871102360704/t0(0) o103->MGC192.168.203.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788970592 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788970576.525715:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788970576.525717:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788970576.525718:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788970576.525721:0:3651:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970576.525727:0:3651:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1788970576.525786:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a7e86331800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1788970576.525820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102358912:0@lo:400:kworker.0 00000100:00080000:0.0:1788970576.525823:0:3651:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e86331800 using connection 192.168.203.115@tcp/0@lo 00000100:00080000:3.0:1788970576.526083:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a7e86331800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:3.0:1788970576.526102:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3c12dceb-6b52-416d-b090-7691eb149d35:3652:1875871102360192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970576.526215:0:3651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebba8da40 x1875871102360832/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970576.526253:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102360704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970576.526262:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102360320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970576.526266:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3c12dceb-6b52-416d-b090-7691eb149d35:3650:1875871102359936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970576.526290:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102360832:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788970576.526336:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102360832 offset 0 length 520: 4 00000100:00100000:0.0:1788970576.526423:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3c12dceb-6b52-416d-b090-7691eb149d35:3651:1875871102360064:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788970576.535637:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a7e8828cd40) has no exports 00000020:01000000:2.0:1788970576.571623:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e95727780 - data ffff8a7e9335e798/ffff8a7d830b0c00 00000020:01000000:2.0:1788970576.571793:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7e854bb600 - data ffff8a7d81c9d948/ffff8a7eaf112800 00000001:00000004:2.0:1788970576.585542:0:20921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00010000:00010000:0.0:1788970576.604569:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970576.621088:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788970576.621097:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788970576.621105:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788970576.623661:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970576.623667:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788970576.623706:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970576.623708:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788970576.623990:0:17891:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788970576.623995:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788970576.624016:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788970576.624740:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970576.624744:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788970576.624784:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970576.624786:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788970576.625090:0:17893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788970576.625094:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788970576.625101:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788970576.626275:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fa98 00000020:00000080:2.0:1788970576.626284:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eaec81000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788970576.626983:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6faad 00000020:00000080:2.0:1788970576.626989:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7e88b2c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970576.627282:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec81000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788970576.627406:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788970576.627413:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970576.627422:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788970576.627426:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a7e8828b380) has no exports 00000004:01000000:2.0:1788970576.627566:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788970576.627575:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fb01 00000020:00000080:2.0:1788970576.627600:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7d8370d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970576.627719:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b2c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788970576.627770:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788970576.627775:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970576.627780:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970576.627783:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a7eae150000) has no exports 00000020:00000080:2.0:1788970576.627788:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fafa 00000020:00000080:2.0:1788970576.627792:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7ebf501800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788970576.627809:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d8370d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1788970576.628229:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788970576.628233:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788970576.628237:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788970576.628242:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970576.628244:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970576.628290:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf501800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788970576.628588:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970576.628666:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970576.628673:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6faec 00000020:00000080:2.0:1788970576.628678:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eb1454000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788970576.628682:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788970576.628686:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970576.628689:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970576.628692:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a7ebd8eb380) has no exports 00000020:00000080:2.0:1788970576.628696:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fade 00000020:00000080:2.0:1788970576.628698:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eb3da6000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788970576.629070:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788970576.629073:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788970576.629076:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788970576.629079:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788970576.629081:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788970576.629105:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970576.629111:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788970576.629120:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788970576.629125:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fad0 00000020:00000080:2.0:1788970576.629130:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eb1452800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788970576.629142:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788970576.629145:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970576.629148:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970576.629151:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8a7e88288000) has no exports 00000020:00000080:2.0:1788970576.629155:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fac9 00000020:00000080:2.0:1788970576.629158:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7e88b2e000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788970576.629268:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf505000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788970576.629284:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7e88b2b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970576.629287:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b2b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788970576.629292:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970576.629367:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1454000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788970576.629373:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3da6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788970576.629377:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb3da2000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788970576.629404:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7ebf504000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970576.629406:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf504000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788970576.629409:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970576.629438:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb1452800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788970576.629442:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b2e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788970576.631436:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788970576.631444:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970576.631447:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788970576.631454:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788970576.631497:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970576.631507:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788970576.631580:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7e88b2f800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788970576.631599:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7e88b29800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788970576.631602:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b29800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788970576.631608:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970576.631804:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970576.631819:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970576.631823:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eaec80800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788970576.631825:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec80800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788970576.631831:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788970576.631953:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fab4 00000020:00000080:0.0:1788970576.631960:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7e88b2b800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788970576.631972:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788970576.631976:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970576.631980:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788970576.631983:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a7e882899c0) has no exports 00000020:00000080:0.0:1788970576.632000:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970576.632003:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788970576.632007:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fabb 00000020:00000080:0.0:1788970576.632010:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7e88b28000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788970576.632017:0:20921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7ebf423000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788970576.632020:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebf423000 2 00000020:01000004:0.0:1788970576.632023:0:20921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7ebf423000 from lustre-MDT0001 00000020:00000080:0.0:1788970576.632037:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970576.632040:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788970576.632042:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eaec83800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788970576.632044:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec83800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788970576.632050:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788970576.632078:0:20921:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788970576.632082:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788970576.632084:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970576.632087:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788970576.632094:0:20921:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a7eaa730000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788970576.632098:0:20921:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8a7eae093380) has exports, disconnecting them 00000020:00080000:0.0:1788970576.632103:0:20921:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a7eaa730000), last request at 1788970500 00000020:00000080:0.0:1788970576.632107:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fb39 00000020:00080000:0.0:1788970576.632118:0:20921:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eaa730000): rc 0 00000020:00000080:0.0:1788970576.632129:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eaa730000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788970576.632497:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b2b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788970576.632502:0:13708:0:(genops.c:885:class_export_put()) final put ffff8a7eaec85800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788970576.632504:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaec85800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788970576.632511:0:13708:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788970576.632762:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e88b28000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788970576.632767:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaa730000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788970576.633536:0:20921:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788970576.633541:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970576.633545:0:20921:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788970576.633550:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970576.633567:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eaa732800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788970576.633721:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970576.633734:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788970576.633737:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7ebf502000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788970576.633740:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf502000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788970576.633743:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788970576.633782:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebf423000 1 00000020:00000080:1.0:1788970576.633787:0:20921:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fa60 00000020:00000080:1.0:1788970576.633792:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7d82790000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788970576.633800:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788970576.633806:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82790000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788970576.633815:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970576.633822:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970576.633825:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8a7eb3dc3380) has no exports 00000020:00000080:1.0:1788970576.724089:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970576.724103:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788970576.724108:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7ebf421000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788970576.724112:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebf421000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788970576.724124:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788970576.724339:0:20921:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7ebf426000 00000020:01000000:1.0:1788970576.724361:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788970576.724365:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970576.724374:0:20921:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970576.724378:0:20921:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a7eb3dc4d40) has no exports 00000100:00100000:3.0:1788970576.725850:0:19483:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a7d810cf200:19483] 3 exiting: rc = 0 00000100:00100000:1.0:1788970576.726263:0:17152:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a7eb59bbc00:17152] 2 exiting: rc = 0 00000100:00100000:0.0:1788970576.726589:0:17150:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a7d81a60000:17150] 0 exiting: rc = 1 00000100:00100000:2.0:1788970576.730128:0:17151:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a7d8276be00:17151] 1 exiting: rc = 0 00000100:00100000:0.0:1788970576.730291:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730298:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730305:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730310:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730316:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730321:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730326:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730331:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730336:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730342:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730347:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730353:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730359:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730364:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730371:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730376:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730415:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730423:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730430:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730436:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730442:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730449:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730455:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730459:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730465:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730471:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730477:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730494:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730500:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730507:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730513:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730518:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730524:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730548:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730554:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730560:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730566:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730571:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730582:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730588:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730594:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730599:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730605:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730611:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730617:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730623:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730628:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730635:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730640:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730646:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730651:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730657:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730662:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730667:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730699:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730705:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730710:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730716:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730729:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730735:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730740:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.730746:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.731036:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.731046:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.734829:0:17154:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a7eb59bb600:17154] 1 exiting: rc = 0 00000100:00100000:3.0:1788970576.735050:0:17153:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a7eb59ba200:17153] 0 exiting: rc = 1 00000100:00100000:0.0:1788970576.735134:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735142:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735148:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735154:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735174:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735179:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735184:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735243:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735250:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735256:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735261:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735266:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735271:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735277:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735282:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735287:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735292:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735296:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735300:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735305:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735309:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735313:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735318:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735323:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735327:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735332:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735337:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735343:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735349:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735353:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735359:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735364:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735369:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735374:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735552:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735562:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735567:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735571:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735576:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735588:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735593:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735598:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735603:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735608:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735612:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735618:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735623:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735627:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735632:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735636:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735641:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735646:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735651:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735656:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735661:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735665:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735670:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735675:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735680:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735684:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735689:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735694:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735699:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.735704:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736256:0:17155:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a7e92e8ae00:17155] 0 exiting: rc = 1 00000100:00100000:3.0:1788970576.736408:0:17156:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a7eb59bb000:17156] 1 exiting: rc = 0 00000100:00100000:2.0:1788970576.736532:0:17890:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8a7e88313c00:17890] 2 exiting: rc = 0 00000100:00100000:0.0:1788970576.736662:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736669:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736674:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736681:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736686:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736692:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736698:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736703:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736709:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736732:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736738:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736744:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736749:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736818:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736825:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736831:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736900:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736908:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736914:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736929:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736934:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736963:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736971:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736977:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736983:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736988:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736993:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.736999:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737005:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737011:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737016:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737022:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737028:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737049:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737056:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737061:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737068:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737074:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737079:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737087:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737094:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737100:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737107:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737114:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737126:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737147:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737154:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737159:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737164:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737169:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737175:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737180:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737186:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737205:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737213:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737219:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737225:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737246:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737253:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737258:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737265:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737270:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737274:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.737285:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970576.755846:0:17158:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a7ebbab3e00:17158] 1 exiting: rc = 0 00000100:00100000:2.0:1788970576.756253:0:17157:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a7d82400400:17157] 0 exiting: rc = 1 00000100:00100000:1.0:1788970576.756432:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756440:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756445:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756451:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756457:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756462:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756467:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756472:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756493:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756498:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756504:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756509:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756514:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756520:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756524:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756529:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756534:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756539:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756545:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756550:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756555:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756560:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756565:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756580:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756585:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756591:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756596:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756602:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756607:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756611:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756616:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756621:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756626:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756630:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756636:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756640:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756644:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756649:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756653:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756658:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756663:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756667:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756672:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756685:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756689:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756694:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756699:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756703:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756708:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756713:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756718:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756723:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756728:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756733:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756738:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756742:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756747:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756905:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756912:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756917:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756923:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756928:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756933:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.756946:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970576.757295:0:17160:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a7ebbab2800:17160] 1 exiting: rc = 0 00000100:00100000:3.0:1788970576.757436:0:17159:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a7d8217d200:17159] 0 exiting: rc = 1 00000100:00100000:1.0:1788970576.757582:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757589:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757595:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757600:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757605:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757610:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757616:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757621:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757627:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757632:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757637:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757643:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757648:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757653:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757668:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757673:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757677:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757681:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757686:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757691:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757696:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757701:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757706:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757711:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757716:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757721:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757726:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757732:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757736:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757742:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757747:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757919:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757928:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757933:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757946:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757953:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757959:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757964:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757970:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757974:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757979:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757984:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757989:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757995:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.757999:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758004:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758010:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758014:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758019:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758031:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758036:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758041:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758046:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758050:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758055:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758060:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758064:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758069:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758074:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758079:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758084:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758090:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758095:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.758099:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970576.759026:0:17162:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a7ebb8e3e00:17162] 1 exiting: rc = 0 00000100:00100000:3.0:1788970576.759312:0:17161:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a7eaeda2000:17161] 0 exiting: rc = 1 00000100:00100000:1.0:1788970576.759683:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759690:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759695:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759700:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759704:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759709:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759714:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759720:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759726:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759731:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759736:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759742:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759747:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759763:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759768:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759773:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759778:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759783:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759788:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759793:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759812:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759816:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759821:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759826:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759831:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759846:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759852:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759862:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759867:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759872:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759877:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759883:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759887:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759893:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759897:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759902:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759907:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759912:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759917:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759922:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759927:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759932:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759948:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759954:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759959:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759965:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759969:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759974:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759979:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759983:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759988:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759993:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.759997:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760002:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760006:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760019:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760024:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760030:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760035:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760040:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760045:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760050:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760055:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970576.760060:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788970576.761184:0:17163:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a7ebb8e2a00:17163] 0 exiting: rc = 1 00000100:00100000:0.0:1788970576.762082:0:17164:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a7ebb8e2800:17164] 1 exiting: rc = 0 00000100:00100000:0.0:1788970576.765671:0:17165:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a7ebb8e3800:17165] 2 exiting: rc = 0 00000100:00100000:0.0:1788970576.767516:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767527:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767535:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767543:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767552:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767560:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767571:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767588:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767594:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767612:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767617:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767623:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767628:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767656:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767663:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767671:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767678:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767686:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767695:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767705:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767714:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767723:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767734:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767743:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767751:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767755:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767759:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767766:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767771:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767778:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767782:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767805:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767814:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767820:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767824:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767840:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767844:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767849:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767853:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767857:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767861:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767864:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767869:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767872:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767877:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767880:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767884:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767888:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767896:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767900:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767904:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767909:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767913:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767916:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767920:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767932:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767951:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767958:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767965:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767975:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767981:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767986:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.767993:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970576.768000:0:20921:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788970576.773673:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788970576.773686:0:20921:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788970576.773693:0:20921:0:(genops.c:885:class_export_put()) final put ffff8a7eaed79000/MDS_uuid 00000020:00000080:0.0:1788970576.773697:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaed79000/MDS_uuid for MDS 00000020:01000000:0.0:1788970576.773702:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788970576.773965:0:20921:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788970577.628657:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970578.653543:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788970579.228625:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970579.228635:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970579.228638:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970579.228641:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970579.228645:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970579.228652:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1788970579.228658:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788970579.228670:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7ebf3b0800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970579.228707:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6da40 x1875871102360960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970579.228758:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788970579.228761:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970579.228763:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970579.228767:0:13708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1788970579.228769:0:13708:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788970579.228774:0:13708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7eb0c22800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970579.228785:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6d2c0 x1875871102361216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970579.228834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102360960:0@lo:38:kworker.0 00000400:00000100:0.0:1788970579.228880:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102360960 offset 0 length 520: 4 00000100:00100000:0.0:1788970579.228906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102361216:0@lo:38:kworker.0 00000400:00000100:0.0:1788970579.228931:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361216 offset 0 length 520: 4 00000100:00100000:3.0:1788970579.228947:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102361088:0@lo:400:kworker.0 00000400:00000100:3.0:1788970579.228973:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361088 offset 0 length 224: 4 00000100:00100000:3.0:1788970579.228989:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970579.228998:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102361344:0@lo:400:kworker.0 00000400:00000100:3.0:1788970579.229013:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361344 offset 0 length 224: 4 00010000:00010000:0.0:1788970579.680002:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788970579.910592:0:21124:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788970579.922848:0:21124:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788970579.922900:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970579.922913:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970579.923102:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970579.923109:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970579.923136:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788970579.923142:0:21124:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788970579.923172:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970579.923185:0:21124:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6da40 x1875871102360960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970599 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970579.923310:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788970579.923317:0:21124:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788970579.923323:0:21124:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788970579.923328:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970579.923333:0:21124:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6da40 x1875871102360960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970599 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788970579.923374:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970579.923402:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970579.923411:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970579.923414:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970579.923424:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970579.923432:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970579.923438:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788970579.923440:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 10000000:01000000:1.0:1788970579.923441:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788970579.923446:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788970579.923457:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:1.0:1788970579.923462:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970579.923469:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c6fbd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fbda expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970579.923480:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970579.923481:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970579.923483:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970579.923566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102360960:0@lo:38:kworker.0 00000100:00100000:0.0:1788970579.923609:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788970579.924351:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788970579.924362:0:21124:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6c780 x1875871102361088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970579.924736:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788970579.924743:0:21124:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788970579.924764:0:21124:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d76800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788970579.924838:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102361472:0@lo:39:umount.0 00000400:00000100:1.0:1788970579.924901:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361472 offset 0 length 224: 4 00000100:00100000:3.0:1788970579.925004:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102361088:0@lo:400:kworker.0 00010000:00010000:3.0:1788970580.700635:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970581.276558:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970581.276584:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970581.276588:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970581.276591:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970581.276698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102361600:0@lo:400:kworker.0 00000400:00000100:3.0:1788970581.276741:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361600 offset 0 length 224: 4 00010000:00010000:0.0:1788970581.724586:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970582.748970:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970582.815981:0:19469:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788970582.815990:0:19469:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c27000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788970582.816131:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c27000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788970582.816178:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0c26000 for lustre-OST0001 00000001:00100000:0.0:1788970582.817360:0:18650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788970582.817365:0:18650:0:(genops.c:885:class_export_put()) final put ffff8a7eb0ea1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788970582.818224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0ea1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788970582.818281:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0ea7800 for lustre-OST0000 00010000:00010000:3.0:1788970583.775047:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970584.284673:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970584.284684:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970584.284687:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970584.284690:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970584.284826:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970584.284846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102361728:0@lo:400:kworker.0 00000400:00000100:3.0:1788970584.284911:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361728 offset 0 length 224: 4 00010000:00010000:0.0:1788970584.796608:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970585.820995:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970586.076526:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970576/real 1788970576] req@ffff8a7ebba8da40 x1875871102360832/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970586 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970586.076558:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebba8da40 x1875871102360832/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970586 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970586.076580:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970586.076606:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788970586.076610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102360832:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788970586.076923:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970586.076929:0:13708:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788970586.076933:0:13708:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970586.076938:0:13708:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1788970586.076943:0:13708:0:(import.c:630:import_select_connection()) MGC192.168.203.115@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788970586.076953:0:13708:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e86331800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970586.076985:0:13708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebba8c780 x1875871102361856/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970586.077019:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970586.077023:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970586.077113:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102361984:0@lo:400:kworker.0 00000400:00000100:3.0:1788970586.077166:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102361984 offset 0 length 224: 4 00000100:00100000:1.0:1788970586.077235:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102361856:0@lo:250:kworker.0 00000400:00000100:1.0:1788970586.077258:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102361856 offset 0 length 520: 4 00010000:00010000:3.0:1788970586.844719:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970587.868668:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970588.892968:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970589.148559:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970579/real 1788970579] req@ffff8a7ebba8d2c0 x1875871102361472/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970589.148606:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebba8d2c0 x1875871102361472/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970589.148633:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d76800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970589.148660:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102361472:0@lo:39:umount.0 00000100:00080000:0.0:1788970589.148899:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788970589.148905:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788970589.148911:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788970589.150341:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150362:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150370:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150377:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150561:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970589.150571:0:21124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150580:0:21124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150586:0:21124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150592:0:21124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970589.150611:0:21124:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788970589.150633:0:21124:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788970589.150666:0:21124:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788970589.150671:0:21124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788970589.150676:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970589.150683:0:21124:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970589.150688:0:21124:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a7eae1519c0) has no exports 00000020:00080000:0.0:1788970589.150716:0:21124:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a7eae1519c0) has no exports 00010000:00010000:3.0:1788970589.151007:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970589.151017:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151026:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970589.151030:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151040:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970589.151048:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970589.151053:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970589.151056:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788970589.151059:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788970589.151077:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:3.0:1788970589.151081:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151088:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2000/0xc3abfebe76c6fba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fbb0 expref: -99 pid: 18649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151104:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970589.151109:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151127:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970589.151130:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151136:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970589.151142:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970589.151146:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788970589.151148:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788970589.151150:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788970589.151154:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:3.0:1788970589.151157:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151163:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83024a00/0xc3abfebe76c6feff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6ff06 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970589.151172:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970589.151173:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970589.151175:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970589.151566:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788970589.155824:0:21124:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d831ab6c0 - data ffff8a7eb11d5bd0/ffff8a7d827ee400 00000020:01000000:1.0:1788970589.160887:0:21124:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d825517e0 - data ffff8a7eb12e3d80/ffff8a7ebcfdac00 00100000:10000000:1.0:1788970589.173330:0:21124:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788970589.194365:0:21124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fbbe 00000020:00000080:2.0:1788970589.194378:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7ebbacf800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788970589.194926:0:21124:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81acf000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788970589.194930:0:21124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81acf000 2 00000020:01000004:2.0:1788970589.194933:0:21124:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7d81acf000 from lustre-OST0000 00000020:00000080:2.0:1788970589.194958:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970589.194967:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788970589.194970:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7ebbacf000/lustre-OST0000_UUID 00000020:00000080:2.0:1788970589.194973:0:21124:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbacf000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788970589.194980:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788970589.195303:0:21124:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788970589.195309:0:21124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788970589.195312:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970589.195318:0:21124:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788970589.195324:0:21124:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a7d83708800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970589.195330:0:21124:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff8a7e848519c0) has exports, disconnecting them 00000020:00080000:2.0:1788970589.195345:0:21124:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a7d83708800), last request at 1788970513 00000020:00000080:2.0:1788970589.195349:0:21124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fbe8 00000020:00080000:2.0:1788970589.195359:0:21124:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d83708800): rc 0 00000020:00000080:2.0:1788970589.195364:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7d83708800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788970589.196175:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7ebbacf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788970589.197855:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83708800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788970589.197887:0:21124:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788970589.197891:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788970589.197894:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970589.197910:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970589.197929:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7ebf3b0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788970589.198349:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970589.198358:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788970589.198362:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7eb3e15800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788970589.198365:0:21124:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3e15800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788970589.198369:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788970589.198500:0:21124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788970589.198504:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970589.198508:0:21124:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788970589.198514:0:21124:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a7eb3e14000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788970589.198520:0:21124:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff8a7e84850000) has exports, disconnecting them 00000020:00080000:3.0:1788970589.198525:0:21124:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a7eb3e14000), last request at 1788970513 00000020:00000080:3.0:1788970589.198528:0:21124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fbfd 00000020:00080000:3.0:1788970589.198538:0:21124:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7eb3e14000): rc 0 00000020:00000080:3.0:1788970589.198541:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7eb3e14000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788970589.199935:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3e14000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788970589.264445:0:21124:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788970589.264455:0:21124:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788970589.264459:0:21124:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788970589.264466:0:21124:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970589.264496:0:13708:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83d76800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788970589.264643:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970589.264652:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788970589.264657:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7eb3e10000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788970589.264661:0:21124:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3e10000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788970589.264671:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788970589.264741:0:21124:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81acf000 1 00000020:00000080:1.0:1788970589.264746:0:21124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fb9b 00000020:00000080:1.0:1788970589.264752:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7d82190800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788970589.264760:0:21124:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788970589.264768:0:13708:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82190800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788970589.264777:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970589.264782:0:21124:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788970589.264785:0:21124:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff8a7d83393380) has no exports 00000020:00000080:1.0:1788970589.321128:0:21124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970589.321141:0:21124:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788970589.321146:0:21124:0:(genops.c:885:class_export_put()) final put ffff8a7d81acd800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788970589.321150:0:21124:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d81acd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788970589.321157:0:21124:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788970589.321268:0:21124:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7d81ac8800 00000020:02000400:1.0:1788970589.321310:0:21124:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788970589.920377:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970590.945334:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970591.516447:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970591.516457:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970591.516460:0:13708:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788970591.516463:0:13708:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970591.516594:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102362112:0@lo:400:kworker.0 00000400:00000100:2.0:1788970591.516644:0:3652:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102362112 offset 0 length 224: 4 00010000:00010000:1.0:1788970591.964525:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788970592.755507:0:21326:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788970592.770623:0:21326:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788970592.770725:0:21326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970592.770741:0:21326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970592.770749:0:21326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970592.770756:0:21326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970592.770780:0:21326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788970592.770786:0:21326:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788970592.770811:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970592.770845:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6d2c0 x1875871102361216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970599 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.770907:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788970592.770914:0:21326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788970592.770920:0:21326:0:(import.c:65:import_set_state_nolock()) ffff8a7eb0c22800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788970592.770925:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788970592.770929:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6d2c0 x1875871102361216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788970599 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788970592.770968:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970592.770976:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970592.770996:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970592.770999:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970592.771008:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970592.771015:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970592.771021:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788970592.771023:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788970592.771026:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788970592.771037:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:1.0:1788970592.771041:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970592.771048:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82655c00/0xc3abfebe76c6fc6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fc74 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970592.771060:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970592.771062:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970592.771064:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970592.774445:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788970592.778166:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102361216:0@lo:38:kworker.0 00000100:00100000:0.0:1788970592.778420:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788970592.779216:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788970592.779444:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebdb6c000 x1875871102361344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970595 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.779473:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebba8e580 x1875871102361600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970597 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.779489:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebba8c000 x1875871102361728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.779497:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebba8d680 x1875871102361984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.779505:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebba8c3c0 x1875871102362112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970592.779516:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788970592.779522:0:21326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788970592.779547:0:21326:0:(import.c:65:import_set_state_nolock()) ffff8a7d83689800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788970592.780443:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102361984:0@lo:400:kworker.0 00000100:00100000:1.0:1788970592.780454:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102361344:0@lo:400:kworker.0 00000100:00100000:2.0:1788970592.781437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102361728:0@lo:400:kworker.0 00000100:00100000:2.0:1788970592.781446:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102361600:0@lo:400:kworker.0 00000100:00100000:2.0:1788970592.781482:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788970592.781644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102362240:0@lo:39:umount.0 00000400:00000100:3.0:1788970592.781694:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875871102362240 offset 0 length 224: 4 00010000:00010000:3.0:1788970592.988621:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970594.012603:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970595.036618:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970596.060852:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788970596.636881:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788970596.636891:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788970597.085054:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970598.109162:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970599.133479:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970600.156630:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970601.180813:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788970601.757646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970601.757656:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970602.012510:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970592/real 1788970592] req@ffff8a7ebba8f480 x1875871102362240/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970602.012543:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebba8f480 x1875871102362240/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788970602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970602.012564:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970586/real 1788970586] req@ffff8a7ebba8c780 x1875871102361856/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970602.012581:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebba8c780 x1875871102361856/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788970601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970602.012599:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83689800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788970602.012681:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102362240:0@lo:39:umount.0 00000100:00080000:1.0:1788970602.012688:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970602.012916:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788970602.012921:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102361856:0@lo:250:kworker.0 00000100:00080000:2.0:1788970602.013012:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3c12dceb-6b52-416d-b090-7691eb149d35->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788970602.013017:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788970602.013020:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970602.013024:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1788970602.013030:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.115@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970602.013043:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7e86331800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970602.013079:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf61a40 x1875871102362368/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970602.013906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102362368:0@lo:250:kworker.0 00000400:00000100:1.0:1788970602.013955:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875871102362368 offset 0 length 520: 4 00000100:00080000:0.0:1788970602.016442:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788970602.016454:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788970602.016462:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788970602.019771:0:21326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019790:0:21326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019797:0:21326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019804:0:21326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019913:0:21326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970602.019931:0:21326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019939:0:21326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019945:0:21326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970602.019951:0:21326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020287:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970602.020295:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020321:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970602.020325:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020333:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970602.020339:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970602.020344:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788970602.020356:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788970602.020367:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:3.0:1788970602.020371:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020376:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c6fc43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fc4a expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020583:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970602.020586:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020592:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:3.0:1788970602.020595:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020600:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788970602.020613:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970602.020618:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788970602.020620:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788970602.020625:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:3.0:1788970602.020628:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970602.020635:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970602.020637:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970602.020639:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970602.020727:0:21326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788970602.020732:0:21326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c6fef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fef8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970602.020746:0:21326:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788970602.020769:0:21326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788970602.020782:0:21326:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788970602.020811:0:21326:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788970602.020815:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788970602.020821:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788970602.020827:0:21326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788970602.020831:0:21326:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8a7e84853380) has no exports 00000020:00080000:0.0:1788970602.020854:0:21326:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff8a7e84853380) has no exports 00000020:01000000:0.0:1788970602.023652:0:21326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d830403c0 - data ffff8a7eb10d0798/ffff8a7ebcf18800 00000020:01000000:0.0:1788970602.023850:0:21326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a7d83040720 - data ffff8a7eb1032ca8/ffff8a7ebdb87400 00010000:00010000:1.0:1788970602.024079:0:19487:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788970602.035190:0:21326:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788970602.053960:0:21326:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc58 00000020:00000080:1.0:1788970602.053972:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d831df800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788970602.053993:0:21326:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7eb0ea2800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788970602.053997:0:21326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0ea2800 2 00000020:01000004:1.0:1788970602.054000:0:21326:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a7eb0ea2800 from lustre-OST0001 00000020:00000080:1.0:1788970602.054040:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970602.054050:0:21326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788970602.054053:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d831de800/lustre-OST0001_UUID 00000020:00000080:1.0:1788970602.054056:0:21326:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831de800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788970602.054062:0:21326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788970602.054200:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d831df800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788970602.054499:0:21326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3c12dceb-6b52-416d-b090-7691eb149d35->MGS 00010000:00010000:2.0:1788970602.054516:0:21326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970602.054535:0:21326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970602.054541:0:21326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788970602.054544:0:21326:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788970602.054548:0:21326:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788970602.054629:0:21326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:2.0:1788970602.054633:0:21326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2e00/0xc3abfebe76c6fa67 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6fa6e expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970602.054650:0:21326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788970602.054723:0:21326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970602.054730:0:21326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788970602.054732:0:21326:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788970602.054734:0:21326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788970602.054745:0:21326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a7e86331800 00010000:00010000:2.0:1788970602.054748:0:21326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eae013800/0xc3abfebe76c6f956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3abfebe76c6f95d expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788970602.054775:0:21326:0:(import.c:65:import_set_state_nolock()) ffff8a7e86331800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788970602.054779:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788970602.054781:0:21326:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788970602.054783:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788970602.054787:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788970602.054798:0:21326:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a7ebcf61a40 x1875871102362368/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788970622 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788970602.054868:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788970602.054871:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:1.0:1788970602.054916:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3c12dceb-6b52-416d-b090-7691eb149d35:3648:1875871102362368:0@lo:250:kworker.0 10000000:01000000:2.0:1788970602.054975:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788970602.054982:0:21326:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6f941 00000020:00000080:2.0:1788970602.054986:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7eaed78800/3c12dceb-6b52-416d-b090-7691eb149d35 00000020:01000000:2.0:1788970602.055057:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.115@tcp (flags='') 00000020:00000080:2.0:1788970602.055063:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970602.055068:0:21326:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788970602.055072:0:21326:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a7d83390000) has no exports 10000000:01000000:2.0:1788970602.055102:0:17147:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788970602.055167:0:21326:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.115@tcp: client import never connected 00000100:00080000:2.0:1788970602.055170:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788970602.055172:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788970602.055174:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788970602.055175:0:21326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788970602.055205:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788970602.055211:0:21326:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.115@tcp (uuid 3c12dceb-6b52-416d-b090-7691eb149d35) 00000020:01000000:2.0:1788970602.055217:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788970602.055220:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788970602.055224:0:21326:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788970602.055228:0:21326:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a7d8368b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788970602.055233:0:21326:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff8a7eae090000) has exports, disconnecting them 00000020:00080000:2.0:1788970602.055238:0:21326:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a7d8368b000), last request at 1788970528 00000020:00000080:2.0:1788970602.055241:0:21326:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc82 00000020:00080000:2.0:1788970602.055252:0:21326:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d8368b000): rc 0 00000020:00000080:2.0:1788970602.055256:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d8368b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970602.055375:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eaed78800/3c12dceb-6b52-416d-b090-7691eb149d35 for MGC192.168.203.115@tcp 00000020:00000080:3.0:1788970602.056954:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d8368b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970602.056967:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7e86331800 for MGC192.168.203.115@tcp 00000020:00000080:3.0:1788970602.056975:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7e86331000/3c12dceb-6b52-416d-b090-7691eb149d35 00000020:00000080:3.0:1788970602.056977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7e86331000/3c12dceb-6b52-416d-b090-7691eb149d35 for MGC192.168.203.115@tcp 00000020:01000000:3.0:1788970602.056982:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.115@tcp (3c12dceb-6b52-416d-b090-7691eb149d35) 00010000:01000000:1.0:1788970602.057432:0:21326:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788970602.057446:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788970602.057451:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788970602.057456:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788970602.058916:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788970602.058928:0:21326:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788970602.058934:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788970602.058938:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788970602.058943:0:21326:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788970602.058950:0:21326:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a7d8368a000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788970602.058957:0:21326:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff8a7d83068000) has exports, disconnecting them 00000020:00080000:1.0:1788970602.058962:0:21326:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a7d8368a000), last request at 1788970528 00000020:00000080:1.0:1788970602.059259:0:21326:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc97 00000020:00080000:1.0:1788970602.059281:0:21326:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a7d8368a000): rc 0 00000020:00000080:1.0:1788970602.059287:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d8368a000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788970602.060865:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7eb0c22800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788970602.060878:0:38:0:(genops.c:885:class_export_put()) final put ffff8a7eb0c21000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788970602.060881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb0c21000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788970602.060886:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970602.060934:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d8368a000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788970602.066589:0:21326:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788970602.066597:0:21326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788970602.066602:0:21326:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788970602.066608:0:21326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788970602.066662:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a7d83689800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788970602.066710:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788970602.066927:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788970602.066996:0:19487:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788970602.067104:0:17134:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a7d83c09800:17134] 1 exiting: rc = 0 00000100:00100000:3.0:1788970602.067178:0:17133:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a7d83c09c00:17133] 0 exiting: rc = 1 00000100:00100000:3.0:1788970602.067228:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.067652:0:17137:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a7d83c08800:17137] 2 exiting: rc = 0 00000100:00100000:3.0:1788970602.067848:0:17135:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a7d83c09000:17135] 0 exiting: rc = 1 00000100:00100000:3.0:1788970602.067901:0:17136:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a7d83c08c00:17136] 1 exiting: rc = 0 00000100:00100000:3.0:1788970602.067960:0:20922:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a7d835dc600:20922] 3 exiting: rc = 0 00000100:00100000:3.0:1788970602.068593:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068603:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068610:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068617:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068622:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068628:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068634:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068639:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068645:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068650:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068655:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068660:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068665:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068670:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068675:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068680:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068685:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068690:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068695:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068700:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068706:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.068711:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070230:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070236:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070242:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070248:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070254:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070259:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070264:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070270:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070294:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070300:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070306:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070310:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070315:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070321:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070327:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070333:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070338:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070343:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070348:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070353:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070358:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070363:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070368:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070374:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070392:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070399:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070404:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070410:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070415:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070421:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070426:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070430:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070446:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070453:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070458:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070475:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070480:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070485:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070490:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070495:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070501:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.070506:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788970602.071694:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970602.071705:0:21326:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788970602.071711:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d83689000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788970602.071715:0:21326:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83689000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788970602.071721:0:21326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788970602.072016:0:21326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7eb0ea2800 1 00000020:00000080:3.0:1788970602.072024:0:21326:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3abfebe76c6fc3c 00000020:00000080:3.0:1788970602.072031:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7eb3da7000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788970602.072045:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788970602.072056:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7eb3da7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788970602.072069:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970602.072074:0:21326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970602.072078:0:21326:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff8a7e84854d40) has no exports 00000020:00000080:3.0:1788970602.144076:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970602.144091:0:21326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788970602.144098:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d83d25000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788970602.144103:0:21326:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d83d25000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788970602.144115:0:21326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788970602.144843:0:21326:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a7eb0ea0000 00000020:01000000:3.0:1788970602.144876:0:21326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788970602.144881:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788970602.144886:0:21326:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788970602.144890:0:21326:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8a7eae153380) has no exports 00000020:00000080:3.0:1788970602.144916:0:21326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788970602.144923:0:21326:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788970602.144936:0:21326:0:(genops.c:885:class_export_put()) final put ffff8a7d82197000/OSS_uuid 00000020:00000080:3.0:1788970602.144938:0:21326:0:(genops.c:844:class_export_destroy()) destroying export ffff8a7d82197000/OSS_uuid for OSS 00000020:01000000:3.0:1788970602.144942:0:21326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788970602.146493:0:17146:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788970602.146536:0:18653:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a7d81a60a00:18653] 0 exiting: rc = 1 00000100:00100000:1.0:1788970602.146578:0:18654:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a7d82476a00:18654] 1 exiting: rc = 0 00000100:00100000:2.0:1788970602.146638:0:19264:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a7d83311200:19264] 3 exiting: rc = 0 00000100:00100000:0.0:1788970602.147798:0:18656:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a7d82476c00:18656] 2 exiting: rc = 0 00000100:00100000:0.0:1788970602.147876:0:19710:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8a7d83684e00:19710] 4 exiting: rc = 0 00000100:00100000:0.0:1788970602.147959:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147969:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147975:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147981:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147987:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147993:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.147998:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148004:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148009:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148014:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148019:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148024:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148029:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148034:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148039:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148045:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148050:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148055:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148061:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148067:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148086:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148091:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148097:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148102:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148107:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148113:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148119:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148124:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148129:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148134:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148139:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148145:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148150:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148155:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148161:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148167:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148248:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148258:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148262:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148268:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148273:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148278:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148292:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148298:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148303:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148307:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148313:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148318:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148323:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148329:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148334:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148340:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148346:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148351:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148356:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148369:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148374:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148379:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148411:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148416:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148422:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148428:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148433:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.148438:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149365:0:18658:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a7ebcf1c200:18658] 1 exiting: rc = 0 00000100:00100000:0.0:1788970602.149480:0:18657:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a7d82477600:18657] 0 exiting: rc = 1 00000100:00100000:0.0:1788970602.149544:0:20378:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a7ebcf84a00:20378] 2 exiting: rc = 0 00000100:00100000:0.0:1788970602.149606:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149613:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149619:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149623:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149628:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149633:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149639:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149644:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149798:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149810:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149815:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149821:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149826:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149831:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149837:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149842:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149848:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149853:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149859:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149865:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149870:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149876:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149894:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149900:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149905:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149910:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149915:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149921:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149926:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149931:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149937:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149942:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149948:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149954:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149960:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149966:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149971:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149976:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149981:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149986:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149991:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.149997:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150003:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150008:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150013:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150019:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150024:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150030:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150035:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150041:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150046:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150052:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150057:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150063:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150075:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150081:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150086:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150099:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150104:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150109:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150114:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150119:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150124:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.150129:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.152223:0:18660:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a7d82477e00:18660] 1 exiting: rc = 0 00000100:00100000:0.0:1788970602.152378:0:18659:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a7d82476600:18659] 0 exiting: rc = 1 00000100:00100000:2.0:1788970602.155595:0:18661:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a7d82477c00:18661] 2 exiting: rc = 0 00000100:00100000:0.0:1788970602.155711:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155720:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155726:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155732:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155738:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155743:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155766:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155774:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155779:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155784:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155789:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155795:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155800:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155805:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155809:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155829:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155836:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155843:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155849:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155855:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155861:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155867:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155872:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155878:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155883:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155888:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155893:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155915:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155920:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155925:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155931:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155937:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155942:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155948:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155953:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155959:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155964:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155970:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155976:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.155997:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156004:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156009:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156015:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156020:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156027:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156032:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156037:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156043:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156049:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156054:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156060:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156066:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156071:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156077:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156083:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156089:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156104:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156112:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156118:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156123:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156137:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156143:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156156:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.156168:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788970602.170078:0:18663:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a7ebcf6ec00:18663] 1 exiting: rc = 0 00000100:00100000:2.0:1788970602.170909:0:18662:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a7d83c14400:18662] 0 exiting: rc = 1 00000100:00100000:1.0:1788970602.171294:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171304:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171310:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171315:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171320:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171325:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171339:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171345:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171350:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171356:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171361:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171366:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171371:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171377:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171402:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171408:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171414:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171419:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171424:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171428:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171433:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171437:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171442:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171447:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171451:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171456:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171461:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171466:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171471:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171476:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171480:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171484:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171489:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171494:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171498:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171503:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171508:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171513:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171518:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171523:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171528:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171541:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171780:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171791:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171797:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171801:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171807:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171812:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171818:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171823:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171828:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171832:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171837:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171843:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171848:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171853:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171859:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171864:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171871:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171879:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171884:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171891:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171896:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.171900:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788970602.172820:0:18664:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a7ebb5a9600:18664] 0 exiting: rc = 1 00000100:00100000:2.0:1788970602.172929:0:18665:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a7d8217ce00:18665] 1 exiting: rc = 0 00000100:00100000:1.0:1788970602.172961:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.172968:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.172980:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.172991:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173003:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173009:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173015:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173041:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173052:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173058:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173065:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173070:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173083:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173088:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173093:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173100:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173105:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173110:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173116:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173135:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173142:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173148:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173154:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173160:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173167:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173228:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173236:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173242:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173248:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173254:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173262:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173409:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173419:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173425:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173431:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173438:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173444:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173449:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173455:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173461:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173512:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173521:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173527:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173557:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173565:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173575:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173582:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173596:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173607:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173614:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173620:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173626:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173632:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173638:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173644:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173663:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173670:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173676:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173682:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173688:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173694:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173700:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173706:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788970602.173719:0:21326:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788970602.182983:0:21326:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788970619.667807:0:22090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788970627.060078:0:22690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788970627.060085:0:22690:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788970627.060087:0:22690:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788970627.060195:0:22690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7d827a9000 00000020:01000004:0.0:1788970627.060211:0:22690:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788970627.060220:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788970627.060235:0:22690:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a7eae094d40) 00000020:00000080:0.0:1788970627.060248:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788970627.130728:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788970627.132134:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788970627.135180:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.136933:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.140074:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.143351:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.145131:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.145998:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.146598:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.147075:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.149039:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.149596:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788970627.151451:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.152694:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788970627.154723:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.157272:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.157635:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.157823:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.158080:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.158260:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.158617:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.158996:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.159223:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.159457:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.159751:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.160050:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.160340:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.160620:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.160798:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.161105:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.161277:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.161603:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.161774:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.161988:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.162212:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.162376:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.162768:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.163061:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.163279:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.163615:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.164015:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.164228:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.164599:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.164834:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.165096:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788970627.165260:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.165609:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788970627.166461:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.166895:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.167146:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.167632:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.168006:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788970627.168193:0:22690:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788970627.168874:0:22690:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788970627.169091:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788970627.169103:0:22690:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970627.169113:0:22690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c70247 00000020:01000004:1.0:1788970627.169119:0:22690:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788970627.169123:0:22690:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788970627.169128:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d827a9000 from MGS 00000020:01000004:1.0:1788970627.169131:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788970627.169140:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a7eae150000) 00000020:00000080:1.0:1788970627.169149:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788970627.169202:0:22690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d827a9000 from MGS, refs=2 00080000:01000000:1.0:1788970627.169206:0:22690:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788970627.169210:0:22690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c70255 00000100:00100000:1.0:1788970627.169304:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788970627.169460:0:22690:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788970627.169466:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788970627.170162:0:22690:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788970627.170170:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788970627.170765:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970627.170907:0:22690:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788970627.170913:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788970627.171904:0:22690:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788970627.171913:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788970627.172258:0:22690:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788970627.172264:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788970627.173261:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.173266:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.173268:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.176268:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.176274:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.176277:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970627.177622:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788970627.183913:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788970627.184673:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788970627.186684:0:22702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788970627.187307:0:22690:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788970627.187370:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788970627.189338:0:22690:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788970627.189872:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970627.190044:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788970627.190049:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788970627.192991:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788970627.193005:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788970627.193314:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788970627.193322:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788970627.197565:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788970627.197597:0:22690:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.115@tcp' 00000020:01000004:3.0:1788970627.197599:0:22690:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788970627.197628:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.115@tcp (typ=mgc) 00000020:00000080:3.0:1788970627.197640:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.115@tcp (ffff8a7d83068000) 00000020:00000080:3.0:1788970627.197655:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788970627.197738:0:22690:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf3ec800@MGC192.168.203.115@tcp: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970627.197882:0:22690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.115@tcp-0 is initialized 00000040:01000000:3.0:1788970627.197888:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788970627.198433:0:22707:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788970627.199610:0:22708:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788970627.199656:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.115@tcp (uuid 6508eee8-107f-49e3-8ffd-bb9a27e50b6d) 00000020:00000080:3.0:1788970627.199675:0:22690:0:(genops.c:1384:class_connect()) connect: client 6508eee8-107f-49e3-8ffd-bb9a27e50b6d, cookie 0xc3abfebe76c70263 00000100:00080000:3.0:1788970627.199687:0:22690:0:(import.c:545:import_select_connection()) MGC192.168.203.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970627.199698:0:22690:0:(import.c:666:import_select_connection()) MGC192.168.203.115@tcp: import ffff8a7ebf3ec800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970627.199731:0:22690:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830eb0c0 x1875871102362496/t0(0) o250->MGC192.168.203.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970627.199755:0:22690:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6508eee8-107f-49e3-8ffd-bb9a27e50b6d->MGS 00000020:01000004:3.0:1788970627.199773:0:22690:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788970627.199778:0:22690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788970627.199790:0:22690:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a7d8306cd40) 00000020:00000080:3.0:1788970627.199800:0:22690:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788970627.200505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3648:1875871102362496:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788970627.200571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.201399:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102362496 00000100:00100000:2.0:1788970627.201409:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102362496 00000100:00100000:2.0:1788970627.201442:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970627.201450:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3648:x1875871102362496:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788970627.201482:0:22703:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6508eee8-107f-49e3-8ffd-bb9a27e50b6d@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:2.0:1788970627.201510:0:22703:0:(genops.c:1384:class_connect()) connect: client 6508eee8-107f-49e3-8ffd-bb9a27e50b6d, cookie 0xc3abfebe76c70271 00000100:00080000:2.0:1788970627.201661:0:22703:0:(import.c:65:import_set_state_nolock()) ffff8a7eaecc5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970627.201731:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:3648:x1875871102362496:12345-0@lo:250:mount.lustre.0 Request processed in 281us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970627.201738:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970627.202316:0:3648:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788970627.202327:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.115@tcp: connect to target with instance 0 00000100:00080000:1.0:1788970627.202334:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788970627.202345:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788970627.202349:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf3ec800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788970627.202352:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788970627.202428:0:3648:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788970627.202434:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3648:1875871102362496:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788970627.217901:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970627.218092:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970627.218098:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788970627.218973:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970627.218986:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788970627.219662:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788970627.219671:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788970627.220715:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970627.220940:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788970627.220945:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788970627.222160:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788970627.222169:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788970627.257267:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970627.257664:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788970627.257670:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788970627.258913:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788970627.258926:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788970627.259634:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970627.259797:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788970627.259802:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788970627.260253:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970627.260260:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788970627.260796:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970627.260931:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788970627.260935:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788970627.261369:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970627.261375:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788970627.261959:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970627.262093:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788970627.262098:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788970627.262801:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788970627.262808:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788970627.277924:0:22690:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970627.278147:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788970627.278153:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788970627.279692:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970627.279703:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788970627.280540:0:22690:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788970627.280548:0:22690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788970627.281328:0:22690:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788970627.281355:0:22690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788970627.281361:0:22690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788970627.281652:0:22690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788970627.281684:0:22690:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788970627.281688:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788970627.281690:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970627.281692:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970627.281693:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970627.281694:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970627.281698:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970627.281700:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970627.281701:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970627.281702:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970627.281703:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970627.281706:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788970627.281708:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970627.281709:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788970627.281710:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970627.281711:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970627.281712:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970627.281713:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970627.281713:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788970627.281714:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788970627.281715:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970627.281716:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788970627.281743:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788970627.281763:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970627.281905:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.281976:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.282023:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102362624 00000100:00100000:0.0:1788970627.282035:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102362624 00000100:00100000:0.0:1788970627.282127:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970627.282136:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:22690:x1875871102362624:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788970627.282182:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788970627.282185:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788970627.282188:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788970627.282641:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788970627.285049:0:22705:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788970627.287092:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788970627.287100:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788970627.287104:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788970627.287107:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788970627.287278:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788970627.289378:0:22705:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788970627.289637:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788970627.291684:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:22690:x1875871102362624:12345-0@lo:253:mount.lustre.0 Request processed in 9541us (9772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.291703:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970627.291790:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970627.291805:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788970627.291867:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970627.291870:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788970627.291871:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970627.291872:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970627.291874:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970627.291875:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970627.291876:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788970627.291878:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788970627.291880:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970627.291881:0:22690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788970627.291900:0:22690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d827a9000 from lustre-MDT0000 10000000:01000000:2.0:1788970627.291932:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788970627.291935:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788970627.291939:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a7d83068000 10000000:01000000:2.0:1788970627.291943:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970627.291950:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a7d83068000 from 1 10000000:01000000:2.0:1788970627.291953:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788970627.291986:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.291997:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.292007:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970627.292039:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970627.292084:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.292157:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.292193:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102362752 00000100:00100000:0.0:1788970627.292199:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102362752 00000100:00100000:0.0:1788970627.292264:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970627.292273:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:22690:x1875871102362752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970627.292285:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970627.292300:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83025e00/0xc3abfebe76c7027f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70278 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.292323:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025e00/0xc3abfebe76c7027f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70278 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.292334:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83025e00/0xc3abfebe76c7027f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70278 expref: 6 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.292343:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025e00, rc 0) 00000100:00100000:0.0:1788970627.292407:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+6:22690:x1875871102362752:12345-0@lo:101:mount.lustre.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.292413:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970627.292484:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970627.292495:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.292503:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970627.292550:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970627.292593:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.296467:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102362880 00000100:00100000:3.0:1788970627.296518:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970627.296541:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102362880 00000100:00100000:2.0:1788970627.296598:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970627.296608:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+6:22690:x1875871102362880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970627.296825:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+6:22690:x1875871102362880:12345-0@lo:501:mount.lustre.0 Request processed in 218us (4230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788970627.296833:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970627.296979:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102362880:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788970627.297017:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788970627.297039:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297050:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970627.297059:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7d827a9000 10000000:01000000:3.0:1788970627.297065:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788970627.297069:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7d827a9000 10000000:01000000:3.0:1788970627.297072:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788970627.297078:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7d827a9000 from 1 10000000:01000000:3.0:1788970627.297081:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788970627.297112:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297120:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297129:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970627.297149:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970627.297181:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.297202:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363008 00000100:00100000:3.0:1788970627.297207:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363008 00000100:00100000:3.0:1788970627.297248:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970627.297254:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+6:22690:x1875871102363008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970627.297263:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970627.297276:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c7028d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70286 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297296:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c7028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70286 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297307:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5e00/0xc3abfebe76c7028d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70286 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297315:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5e00, rc 0) 00000100:00100000:3.0:1788970627.297339:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+7:22690:x1875871102363008:12345-0@lo:101:mount.lustre.0 Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.297345:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970627.297374:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.297607:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970627.297619:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7028d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297628:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7028d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970627.297641:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788970627.297686:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7028d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297705:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4400/0xc3abfebe76c70286 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7028d expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970627.297718:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788970627.297722:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970627.297726:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7d827a9000 10000000:01000000:3.0:1788970627.297728:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788970627.297731:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788970627.297733:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788970627.297748:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297755:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297763:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970627.297776:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970627.297802:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.297835:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363136 00000100:00100000:3.0:1788970627.297839:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363136 00000100:00100000:3.0:1788970627.297862:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970627.297867:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+7:22690:x1875871102363136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970627.297874:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970627.297881:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c7029b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70294 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297894:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c7029b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70294 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297915:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5800/0xc3abfebe76c7029b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70294 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.297921:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5800, rc 0) 00000100:00100000:3.0:1788970627.297944:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+8:22690:x1875871102363136:12345-0@lo:101:mount.lustre.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.297951:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970627.297981:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.297991:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970627.298000:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7029b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970627.298008:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7029b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970627.298051:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970627.298074:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.298092:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363264 00000100:00100000:3.0:1788970627.298096:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363264 00000100:00100000:3.0:1788970627.298118:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970627.298123:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+8:22690:x1875871102363264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970627.298224:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22690:x1875871102363264:12345-0@lo:501:mount.lustre.0 Request processed in 100us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.298230:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788970627.298252:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.298263:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970627.298293:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970627.298326:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.298343:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363392 00000100:00100000:3.0:1788970627.298347:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363392 00000100:00100000:3.0:1788970627.298364:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970627.298369:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22690:x1875871102363392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970627.299083:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8333fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.299959:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22690:x1875871102363392:12345-0@lo:503:mount.lustre.0 Request processed in 1585us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.299969:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788970627.300037:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102363392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970627.300462:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22729:1875871102363520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970627.300586:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.300619:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.300669:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363520 00000100:00100000:3.0:1788970627.300675:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363520 00000100:00100000:3.0:1788970627.300949:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970627.300958:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22729:x1875871102363520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970627.301542:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22729:x1875871102363520:12345-0@lo:502:llog_process_th.0 Request processed in 585us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.301550:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970627.301669:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22729:1875871102363520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970627.301712:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.301724:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.301726:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788970627.301730:0:22729:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788970627.301733:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970627.301748:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a7eae154d40) 00000020:00000080:1.0:1788970627.301762:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788970627.301767:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788970627.303026:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788970627.303039:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c702a9 00000020:00000080:1.0:1788970627.303255:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788970627.303263:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.303268:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.303270:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788970627.303274:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.303279:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.303287:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788970627.303292:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970627.303304:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a7eae153380) 00000020:00000080:1.0:1788970627.303326:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788970627.303332:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788970627.303334:0:22729:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788970627.303337:0:22729:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788970627.303343:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788970627.303412:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d827a9000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788970627.303424:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a7eae1519c0) 00000020:00000080:1.0:1788970627.303432:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788970627.303495:0:22729:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788970627.303500:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c702be 00000020:00000080:1.0:1788970627.303628:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788970627.303634:0:22729:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788970627.303638:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3abfebe76c702c5 00080000:01000000:1.0:1788970627.303642:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788970627.303646:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c702cc 00010000:00010000:0.0:1788970627.375197:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788970627.377443:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:0.0:1788970627.377968:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788970627.378955:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a7eae090000) 00000020:00000080:0.0:1788970627.378981:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788970627.379063:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788970627.379070:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c702da 00000020:00000080:0.0:1788970627.379907:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788970627.388001:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3abfebe76c702e1 00000020:00000080:1.0:1788970627.391107:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788970627.391124:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.391133:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.391135:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788970627.391139:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788970627.391141:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788970627.391143:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970627.391144:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970627.391146:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788970627.391149:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.391150:0:22729:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788970627.391153:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.391159:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.391160:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788970627.391165:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788970627.391221:0:22729:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788970627.391254:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.391257:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.391258:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788970627.391262:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.391264:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.391266:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788970627.391268:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788970627.391273:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:1.0:1788970627.391297:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970627.391313:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a7e882899c0) 00000020:00000080:1.0:1788970627.391331:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788970627.391335:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788970627.391413:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788970627.391420:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788970627.391428:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c702ef 00010000:00080000:1.0:1788970627.391464:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d827af000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970627.397326:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788970627.400303:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788970627.400318:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788970627.400360:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788970627.402143:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c702f6 00000100:00080000:2.0:1788970627.402164:0:22729:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970627.402176:0:22729:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7d827af000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970627.402220:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf60f00 x1875871102363648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970627.402244:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788970627.402364:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970627.402371:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.402372:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788970627.402376:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970627.402378:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788970627.402396:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970627.402398:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970627.402418:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970627.402421:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.402423:0:22729:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970627.402426:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970627.402432:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788970627.402436:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.402437:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788970627.402441:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970627.402445:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000100:00100000:1.0:1788970627.402474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363648:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788970627.402482:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788970627.402486:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970627.402502:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a7ebd8e8000) 00000020:00000080:2.0:1788970627.402519:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788970627.402525:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788970627.402546:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788970627.402615:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788970627.402622:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000100:00100000:0.0:1788970627.402624:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102363648 00000020:00000080:2.0:1788970627.402630:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c70304 00000100:00100000:0.0:1788970627.402633:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102363648 00010000:00080000:2.0:1788970627.402662:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83708000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.115@tcp at head 00000100:00100000:0.0:1788970627.402681:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970627.402689:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102363648:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788970627.402704:0:22716:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788970627.403789:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788970627.406451:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788970627.407631:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788970627.415010:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970627.415202:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788970627.424840:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:2.0:1788970627.425518:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1875871102363648:12345-0@lo:38:llog_process_th.0 Request processed in 22822us (22968us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788970627.425548:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788970627.425862:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970627.425868:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970627.425871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363648:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788970627.426766:0:22735:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788970627.426772:0:22735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788970627.427588:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970627.427667:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788970627.427712:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788970627.427734:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c7030b 00000100:00080000:1.0:1788970627.427742:0:22729:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970627.427752:0:22729:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7d83708000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970627.427786:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6f0c0 x1875871102363776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970627.427853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363776:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788970627.427900:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102363776 offset 0 length 520: 4 00000100:00080000:1.0:1788970627.427950:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788970627.428006:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.428010:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.428012:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788970627.428014:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788970627.428017:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788970627.428018:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970627.428020:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788970627.428021:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788970627.428023:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.428024:0:22729:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788970627.428027:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788970627.428031:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788970627.428033:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.428034:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788970627.428037:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788970627.428040:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:1.0:1788970627.428060:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788970627.428062:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788970627.428075:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a7e8828cd40) 00000020:00000080:1.0:1788970627.428087:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788970627.428091:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788970627.428158:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788970627.428164:0:22729:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788970627.428170:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3abfebe76c70319 00010000:00080000:1.0:1788970627.428195:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83eff800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:1.0:1788970627.428418:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788970627.428495:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788970627.428512:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788970627.431157:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970627.432236:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788970627.432644:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788970627.433378:0:22737:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788970627.433409:0:22737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788970627.434128:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788970627.434138:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788970627.434172:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788970627.434242:0:22729:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c70320 00000100:00080000:1.0:1788970627.434253:0:22729:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788970627.434265:0:22729:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970627.434299:0:22729:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6f840 x1875871102363904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788970627.434358:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363904:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788970627.434436:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102363904 offset 0 length 520: 4 00000100:00080000:1.0:1788970627.434606:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788970627.434742:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.434747:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.434749:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788970627.434752:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.434757:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.434758:0:22729:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788970627.434761:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788970627.434763:0:22729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788970627.434766:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.434768:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.434769:0:22729:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788970627.434771:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970627.434774:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.434775:0:22729:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788970627.434778:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788970627.434805:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22729:1875871102364032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970627.434853:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.434880:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.434970:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364032 00000100:00100000:0.0:1788970627.434977:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364032 00000100:00100000:0.0:1788970627.435022:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970627.435032:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22729:x1875871102364032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970627.435147:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22729:x1875871102364032:12345-0@lo:502:llog_process_th.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.435154:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970627.435260:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22729:1875871102364032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788970627.435284:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970627.435293:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970627.435294:0:22729:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788970627.435298:0:22729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788970627.435349:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788970627.435369:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788970627.435403:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7029b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.435415:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4e00/0xc3abfebe76c70294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7029b expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970627.435422:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d827a9000 from 1 10000000:01000000:1.0:1788970627.435425:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970627.435450:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.435458:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.435466:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970627.435556:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788970627.435593:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.435615:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.435834:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364160 00000100:00100000:0.0:1788970627.435839:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364160 00000100:00100000:0.0:1788970627.435872:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970627.435879:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+9:22690:x1875871102364160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970627.435888:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970627.435901:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70327 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.435921:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.435943:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 10 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.435951:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024c00, rc 0) 00000100:00100000:0.0:1788970627.435982:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+10:22690:x1875871102364160:12345-0@lo:101:mount.lustre.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.435988:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970627.436059:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970627.436070:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.436079:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970627.438121:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364288:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788970627.438189:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.438231:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8fd67780 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.438570:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364288 00000100:00100000:0.0:1788970627.438586:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364288 00000100:00100000:0.0:1788970627.438632:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970627.438641:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+10:22690:x1875871102364288:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788970627.438658:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788970627.438665:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788970627.439976:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+10:22690:x1875871102364288:12345-0@lo:256:mount.lustre.0 Request processed in 1331us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.439993:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970627.440083:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364288:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788970627.441116:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970627.441148:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.441159:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970627.441167:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d827a9000 from 1 10000000:01000000:2.0:1788970627.441169:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970627.441215:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.441223:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.441234:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970627.441256:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970627.441305:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.441346:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970627.441579:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364416 00000100:00100000:1.0:1788970627.441587:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364416 00000100:00100000:1.0:1788970627.441637:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970627.441646:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+10:22690:x1875871102364416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970627.441657:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970627.441672:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70335 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.441806:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.441818:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 11 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.441828:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ba00, rc 0) 00000100:00100000:1.0:1788970627.441862:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102364416:12345-0@lo:101:mount.lustre.0 Request processed in 218us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.441869:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970627.441948:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970627.441960:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.441969:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970627.442044:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970627.442114:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.442140:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970627.442288:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364544 00000100:00100000:1.0:1788970627.442293:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364544 00000100:00100000:1.0:1788970627.442324:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970627.442338:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102364544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970627.442649:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102364544:12345-0@lo:501:mount.lustre.0 Request processed in 311us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.442656:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970627.442794:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970627.442822:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970627.442861:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.442914:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970627.446055:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364672 00000100:00100000:1.0:1788970627.446070:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364672 00000100:00100000:1.0:1788970627.446189:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970627.446211:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102364672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970627.446370:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102364672:12345-0@lo:503:mount.lustre.0 Request processed in 162us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.446378:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788970627.446975:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102364672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970627.447491:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22739:1875871102364800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970627.447546:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.447942:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.448010:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364800 00000100:00100000:3.0:1788970627.448023:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364800 00000100:00100000:3.0:1788970627.448060:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970627.448068:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22739:x1875871102364800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970627.448659:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22739:x1875871102364800:12345-0@lo:502:llog_process_th.0 Request processed in 591us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.448667:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970627.448867:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22739:1875871102364800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970627.448898:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970627.448908:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.448910:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788970627.448917:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d827a9000 00000020:00000080:2.0:1788970627.448919:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970627.448926:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970627.448928:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.448929:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788970627.448932:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970627.448934:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.448936:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788970627.448939:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d827a9000 00000020:00000080:2.0:1788970627.448941:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970627.449038:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970627.449042:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.449043:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788970627.449046:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970627.449055:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.449056:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970627.449061:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d827a9000 00000020:00000080:2.0:1788970627.449063:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788970627.450333:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970627.450343:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.450345:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788970627.450348:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970627.450351:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.450353:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788970627.450357:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d827a9000 00000020:00000080:2.0:1788970627.450359:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788970627.450626:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22739:1875871102364928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970627.450689:0:22739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970627.450773:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.451550:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102364928 00000100:00100000:3.0:1788970627.451559:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102364928 00000100:00100000:3.0:1788970627.451747:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970627.451759:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22739:x1875871102364928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970627.451896:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22739:x1875871102364928:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970627.451904:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788970627.451915:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22739:1875871102364928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788970627.451946:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970627.451952:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970627.451954:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788970627.451958:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788970627.452284:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788970627.452303:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788970627.452317:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.452329:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970627.452376:0:22690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788970627.452399:0:22690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7d827a9000 10000000:01000000:0.0:1788970627.452402:0:22690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7d827a9000 10000000:01000000:0.0:1788970627.452408:0:22690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970627.452413:0:22690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d827a9000 from 1 10000000:01000000:0.0:1788970627.452415:0:22690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788970627.452447:0:22690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.452461:0:22690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.454583:0:22690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970627.454619:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970627.454681:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.454721:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e85240840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.454757:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365056 00000100:00100000:0.0:1788970627.454764:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365056 00000100:00100000:0.0:1788970627.454805:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970627.454814:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22690:x1875871102365056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970627.454830:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970627.454847:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c7034a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70343 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.454871:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c7034a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70343 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.454882:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83024200/0xc3abfebe76c7034a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70343 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.454889:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83024200, rc 0) 00000100:00100000:0.0:1788970627.454925:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365056:12345-0@lo:101:mount.lustre.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.454932:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970627.454989:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970627.455004:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7034a expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.455014:0:22690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7034a expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970627.455073:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970627.455097:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.455111:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e85240840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.455123:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365184 00000100:00100000:0.0:1788970627.455127:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365184 00000100:00100000:0.0:1788970627.455143:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970627.455148:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970627.455253:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365184:12345-0@lo:501:mount.lustre.0 Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.455260:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970627.455289:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970627.455314:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970627.455352:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.455365:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e85240840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.455377:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365312 00000100:00100000:0.0:1788970627.455397:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365312 00000100:00100000:0.0:1788970627.455414:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970627.455419:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970627.456259:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365312:12345-0@lo:503:mount.lustre.0 Request processed in 835us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.456273:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970627.456327:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970627.475588:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970627.475685:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.475741:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0cb5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.475816:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365440 00000100:00100000:0.0:1788970627.475825:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365440 00000100:00100000:0.0:1788970627.475876:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970627.475886:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788970627.476019:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365440:12345-0@lo:502:llog_process_th.0 Request processed in 134us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970627.476028:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788970627.476135:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365440:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788970627.476192:0:22741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788970627.476207:0:22741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a7d830699c0) 00000020:00000080:3.0:1788970627.476226:0:22741:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788970627.476314:0:22741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d827a9000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788970627.476319:0:22741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d827a9000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788970627.476321:0:22741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d827a9000 4 00010000:00080000:3.0:1788970627.476347:0:22741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7e982a2800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970627.481303:0:22741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788970627.484768:0:22741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788970627.484812:0:22741:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970627.484835:0:22741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3abfebe76c70358 00000100:00080000:3.0:1788970627.484846:0:22741:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970627.484857:0:22741:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a7e982a2800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970627.484889:0:22741:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830e9a40 x1875871102365568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970627.484918:0:22741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970627.485672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102365568:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970627.485734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.486239:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365568 00000100:00100000:0.0:1788970627.486248:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365568 00000100:00100000:0.0:1788970627.486287:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970627.486295:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102365568:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970627.486358:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102365568:12345-0@lo:38:llog_process_th.0 Request processed in 61us (622us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788970627.486364:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788970627.486426:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970627.486433:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e982a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970627.486438:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788970627.486441:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102365568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970627.489716:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788970627.489794:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970627.489829:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0cb5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970627.490095:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365696 00000100:00100000:1.0:1788970627.490104:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365696 00000100:00100000:1.0:1788970627.490150:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970627.490159:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970627.490276:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365696:12345-0@lo:502:llog_process_th.0 Request processed in 118us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.490284:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970627.492370:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970627.494714:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788970627.494807:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.494858:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970627.495216:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365824 00000100:00100000:2.0:1788970627.495225:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365824 00000100:00100000:2.0:1788970627.495308:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970627.495319:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788970627.495673:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22741:x1875871102365824:12345-0@lo:502:llog_process_th.0 Request processed in 355us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970627.495682:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788970627.495685:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22741:1875871102365824:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788970627.496156:0:22741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788970627.496373:0:22690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788970627.496422:0:22690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788970627.496441:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7034a expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.496467:0:22690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83025400/0xc3abfebe76c70343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7034a expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788970627.496524:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788970627.496527:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788970627.496529:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970627.496530:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970627.496532:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970627.496533:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970627.496535:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970627.496536:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788970627.496538:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970627.496539:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788970627.496544:0:22690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788970627.496546:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788970627.496548:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788970627.496549:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970627.496550:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970627.496551:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970627.496552:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970627.496553:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970627.496554:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788970627.496555:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970627.496556:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788970627.496590:0:22690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788970627.496611:0:22690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788970627.496664:0:22690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.496695:0:22690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e85240b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970627.496722:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102365952 00000100:00100000:3.0:1788970627.496736:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102365952 00000100:00100000:3.0:1788970627.496777:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788970627.496786:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788970627.496810:0:22703:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788970627.496824:0:22703:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788970627.499110:0:22703:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788970627.499152:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788970627.499620:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22690:x1875871102365952:12345-0@lo:253:mount.lustre.0 Request processed in 2831us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.499648:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1788970627.503902:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788970627.503913:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788970627.503936:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.503954:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.503970:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.504013:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970627.504028:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 11 pid: 22703 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970627.504043:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102366080:0@lo:104: 00000100:00100000:0.0:1788970627.504103:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970627.504153:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8133a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970627.504192:0:22690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22690:1875871102365952:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970627.504203:0:22690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788970627.504206:0:22690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970627.504208:0:22690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788970627.504209:0:22690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970627.504211:0:22690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970627.504212:0:22690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970627.504214:0:22690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970627.504215:0:22690:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970627.504217:0:22690:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788970627.504218:0:22690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970627.504220:0:22690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788970627.504234:0:22690:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788970627.504553:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366080 00000100:00100000:2.0:1788970627.504560:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366080 00000100:00100000:2.0:1788970627.504610:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970627.504619:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102366080:12345-0@lo:104: 00010000:00010000:2.0:1788970627.504632:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970627.504679:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788970627.504684:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102366080:12345-0@lo:104: Request processed in 67us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970627.504691:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788970627.504762:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970627.504769:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.504776:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970627.504780:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.504788:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970627.504795:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970627.504800:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970627.504842:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.504848:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970627.504873:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.504879:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7032e expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.504894:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.504896:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970627.504898:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970627.504928:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102366208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970627.504967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970627.505031:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366208 00000100:00100000:1.0:1788970627.505035:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366208 00010000:00010000:1.0:1788970627.505055:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 12 pid: 22703 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970627.505075:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970627.505081:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3649:x1875871102366208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970627.505091:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970627.505096:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 12 pid: 22703 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505106:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 12 pid: 22703 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505121:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505129:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970627.505141:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001228838s 00010000:00010000:1.0:1788970627.505145:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505153:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505159:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505177:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505182:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970627.505186:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505193:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505201:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.505211:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970627.505238:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3649:x1875871102366208:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970627.505244:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970627.505272:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102366208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970627.506593:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83024c00/0xc3abfebe76c7032e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70327 expref: 11 pid: 22703 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970627.506609:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102366080:0@lo:104: 00010000:00010000:1.0:1788970627.506632:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.506642:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.506658:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970627.506665:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83025200/0xc3abfebe76c7035f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788970627.524052:0:22690:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1788970627.525881:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788970627.525951:0:22751:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1788970627.525956:0:22751:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788970627.526301:0:22752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788970627.527049:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788970627.529639:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788970627.529996:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788970627.530062:0:22752:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1788970627.530282:0:22753:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a7ebdb6c3c0 x1875871102366336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970627.530293:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000040:01000000:3.0:1788970627.530934:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788970627.530974:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788970627.531693:0:22690:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788970627.531702:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788970627.531740:0:22690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970627.532919:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788970627.533663:0:22690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788970627.533700:0:22690:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788970627.534257:0:22690:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788970627.535068:0:22690:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1788970627.536896:0:22690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788970627.538301:0:22690:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788970627.538338:0:22690:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa287c174b988 00100000:10000000:3.0:1788970627.538346:0:22690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788970627.538959:0:22690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788970627.538974:0:22690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788970627.539005:0:22690:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788970627.539019:0:22690:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788970627.544621:0:22690:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970627.544823:0:22690:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970628.189115:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970628.511896:0:22745:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970628.511906:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970628.516159:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788970628.516176:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788970628.573027:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 10000000:01000000:2.0:1788970629.148459:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970629.148466:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d827a9000 from 11 10000000:01000000:2.0:1788970629.148482:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970629.148539:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970629.148569:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970629.148582:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970629.149127:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102366464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970629.149196:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970629.149243:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970629.149484:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366464 00000100:00100000:3.0:1788970629.149492:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366464 00000100:00100000:1.0:1788970629.149602:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970629.149615:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+11:22708:x1875871102366464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970629.149630:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970629.149997:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70366 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970629.150025:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970629.150036:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970629.150045:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9aa00, rc 0) 00000100:00100000:1.0:1788970629.150103:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22708:x1875871102366464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 491us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970629.150110:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788970629.150212:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102366464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970629.150228:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970629.150237:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970629.150293:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102366592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788970629.150324:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970629.150426:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970629.150604:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366592 00000100:00100000:1.0:1788970629.150615:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366592 00000100:00100000:1.0:1788970629.150649:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970629.150657:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22708:x1875871102366592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788970629.150672:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788970629.150687:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788970629.150690:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788970629.150971:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:22708:x1875871102366592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 314us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970629.150980:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788970629.151041:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102366592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788970629.151083:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970629.151090:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970629.151098:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970629.212652:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970629.533234:0:22745:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788970629.533244:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970629.533360:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788970629.533431:0:22745:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970629.533587:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1788970629.597543:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:0.0:1788970630.236498:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970630.620527:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000001:02000400:1.0:1788970630.914081:0:22996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788970631.260611:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788970631.631307:0:23049:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970631.631539:0:23049:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788970631.647220:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:0.0:1788970632.286442:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970632.324994:0:23099:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970632.325216:0:23099:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788970632.668485:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000100:00080000:1.0:1788970632.988812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970632.988819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788970632.988823:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970632.988831:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:1.0:1788970632.988836:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788970632.988847:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7d827af000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970632.988870:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6e940 x1875871102366848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970632.988891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970632.988894:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970632.988950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970632.988953:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970632.988956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970632.988959:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788970632.988961:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a7e982a2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970632.988967:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a7e982a2800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970632.988982:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6d680 x1875871102366976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970632.989256:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102366848:0@lo:38:kworker.0 00000100:00100000:0.0:1788970632.989327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970632.989407:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102366976:0@lo:38:kworker.0 00000100:00100000:0.0:1788970632.989442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970632.989484:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366976 00000100:00100000:0.0:1788970632.989492:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366976 00000100:00100000:0.0:1788970632.989522:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970632.989530:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1875871102366976:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788970632.989571:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1788970632.989602:0:22713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3abfebe76c70374 00000004:00100000:0.0:1788970632.989615:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970632.989745:0:22713:0:(import.c:65:import_set_state_nolock()) ffff8a7d82195000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970632.989792:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875871102366976:12345-0@lo:38:kworker.0 Request processed in 261us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970632.989800:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970632.990064:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970632.990074:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102366720:0@lo:400:kworker.0 00000100:00100000:3.0:1788970632.990111:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788970632.990258:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7ebdb6d680 x1875871102366976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788970632.990274:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788970632.990281:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788970632.990286:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970632.990288:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e982a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970632.990294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875871102366976:0@lo:38:kworker.0 00000100:00100000:1.0:1788970632.990487:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366848 00000100:00100000:1.0:1788970632.990493:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366848 00000100:00100000:1.0:1788970632.990513:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970632.990519:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102366848:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970632.990541:0:22717:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788970632.990594:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102366848:12345-0@lo:38:kworker.0 Request processed in 74us (1267us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970632.990601:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970632.990621:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366720 00000100:00100000:1.0:1788970632.990624:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366720 00000100:00100000:1.0:1788970632.990660:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970632.990667:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3649:x1875871102366720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970632.990705:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3649:x1875871102366720:12345-0@lo:400:kworker.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970632.990711:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788970632.991181:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102366720:0@lo:400:kworker.0 00000100:00080000:0.0:1788970632.991421:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970632.991431:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970632.991434:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102366848:0@lo:38:kworker.0 00010000:00010000:1.0:1788970633.312864:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970633.692445:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:0.0:1788970634.332833:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970634.717449:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:1.0:1788970635.358984:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970635.742263:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:0.0:1788970636.383926:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970636.768276:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000100:00100000:3.0:1788970637.084539:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970627/real 1788970627] req@ffff8a7ebdb6f840 x1875871102363904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970637.084591:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebdb6f840 x1875871102363904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970637.084603:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970627/real 1788970627] req@ffff8a7ebdb6f0c0 x1875871102363776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970637.084640:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebdb6f0c0 x1875871102363776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970637.084660:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970637.084690:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970637.084694:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363904:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788970637.084701:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83708000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970637.084706:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970637.084710:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102363776:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788970637.085677:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102367104:0@lo:400:kworker.0 00000100:00080000:2.0:1788970637.085695:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788970637.085700:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788970637.085703:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970637.085707:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1788970637.085712:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788970637.085728:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7d827af000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970637.085744:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.085750:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf62940 x1875871102367232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970637.085803:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102367104 00000100:00100000:3.0:1788970637.085812:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102367104 00000100:00100000:0.0:1788970637.085849:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367232:0@lo:38:kworker.0 00000100:00100000:3.0:1788970637.085862:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788970637.085870:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3651:x1875871102367104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970637.085908:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.085922:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:3651:x1875871102367104:12345-0@lo:400:kworker.0 Request processed in 52us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.085928:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970637.085963:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102367232 00000100:00100000:1.0:1788970637.085966:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102367232 00000100:00100000:3.0:1788970637.085970:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102367104:0@lo:400:kworker.0 00000100:00100000:1.0:1788970637.085988:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970637.085993:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102367232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788970637.086010:0:22717:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788970637.086228:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970637.086232:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788970637.086234:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d83708000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788970637.086238:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:2.0:1788970637.086241:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788970637.086247:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7d83708000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970637.086575:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830ebc00 x1875871102367360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970637.093063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367360:0@lo:8:kworker.0 00000400:00000100:0.0:1788970637.093138:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102367360 offset 0 length 520: 4 00000100:00100000:1.0:1788970637.095796:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102367232:12345-0@lo:38:kworker.0 Request processed in 9792us (9877us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970637.095814:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788970637.095938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970637.095944:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970637.095947:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970637.095952:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1788970637.095957:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970637.095969:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970637.096042:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830ea1c0 x1875871102367488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970637.096104:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970637.096119:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102367616:0@lo:400:kworker.0 00000100:00100000:3.0:1788970637.096703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.096791:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102367616 00000100:00100000:2.0:1788970637.096799:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102367616 00000100:00100000:2.0:1788970637.096845:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970637.096854:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102367616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970637.096911:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102367616:12345-0@lo:400:kworker.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.096918:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788970637.097007:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970637.097013:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788970637.097017:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367232:0@lo:38:kworker.0 00000100:00100000:0.0:1788970637.097039:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367488:0@lo:8:kworker.0 00000400:00000100:0.0:1788970637.097064:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102367488 offset 0 length 520: 4 00010000:00080000:1.0:1788970637.097196:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7d830eb480 x1875871102367616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970637.097209:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102367616:0@lo:400:kworker.0 00010000:00010000:1.0:1788970637.404535:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788970637.541579:0:23444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970637.541583:0:23444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788970637.541585:0:23444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788970637.541696:0:23444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7d81a76800 00000020:01000004:3.0:1788970637.541711:0:23444:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788970637.541728:0:23444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788970637.541742:0:23444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a7d8306b380) 00000020:00000080:3.0:1788970637.541759:0:23444:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788970637.653519:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788970637.656976:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.661133:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.661359:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.661983:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.663016:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.666364:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.666936:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.667153:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.667371:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.668169:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.669033:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.669304:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.670033:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.670600:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.670925:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.671195:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.671591:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.672018:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.672279:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.672656:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.672922:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.673098:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.673588:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.674539:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.675144:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.675542:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.676648:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.677015:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.681322:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.681885:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.682169:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788970637.682439:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788970637.682959:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788970637.687507:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.688326:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788970637.688723:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.689086:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788970637.689618:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788970637.689879:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.690096:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.690263:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.690527:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788970637.690808:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788970637.691080:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788970637.691755:0:23444:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:0.0:1788970637.692965:0:23444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788970637.693203:0:23444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788970637.693218:0:23444:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788970637.693233:0:23444:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c70382 00000020:01000004:0.0:1788970637.693241:0:23444:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788970637.693266:0:23444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788970637.693270:0:23444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788970637.693276:0:23444:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788970637.693339:0:23444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788970637.693344:0:23444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788970637.703449:0:23444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788970637.703508:0:23444:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788970637.703513:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788970637.703515:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970637.703517:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970637.703518:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970637.703519:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970637.703521:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970637.703522:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970637.703524:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970637.703526:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970637.703530:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788970637.703533:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788970637.703534:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970637.703536:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970637.703537:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970637.703538:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970637.703539:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970637.703540:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970637.703541:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970637.703542:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970637.703581:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788970637.703603:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102367744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788970637.703680:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.703730:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.703906:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102367744 00000100:00100000:2.0:1788970637.703914:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102367744 00000100:00100000:2.0:1788970637.703978:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788970637.703990:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:23444:x1875871102367744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970637.704022:0:22704:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788970637.704026:0:22704:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788970637.704033:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788970637.704785:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:23444:x1875871102367744:12345-0@lo:253:mount.lustre.0 Request processed in 794us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.704795:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970637.705425:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102367744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970637.705441:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788970637.705444:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970637.705445:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788970637.705447:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970637.705448:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970637.705450:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970637.705451:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970637.705453:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788970637.705466:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970637.705468:0:23444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970637.705490:0:23444:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d81a76800 from lustre-MDT0001 10000000:01000000:0.0:1788970637.705531:0:23444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788970637.705535:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788970637.705542:0:23444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83068000 local copy 00010000:00010000:0.0:1788970637.705552:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970637.705867:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102367872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970637.705909:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.705952:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970637.706087:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102367872 00000100:00100000:1.0:1788970637.706101:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102367872 00000100:00100000:1.0:1788970637.706147:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970637.706159:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:23444:x1875871102367872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970637.706239:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:23444:x1875871102367872:12345-0@lo:501:mount.lustre.0 Request processed in 84us (329us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970637.706246:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788970637.706328:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102367872:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788970637.706342:0:23444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788970637.706359:0:23444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788970637.706365:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.706374:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970637.706748:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7d81a76800 10000000:01000000:3.0:1788970637.706861:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788970637.706870:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a7d83068000 10000000:01000000:3.0:1788970637.706873:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788970637.706876:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a7d83068000 from 1 10000000:01000000:3.0:1788970637.706879:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788970637.706909:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.706918:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.706929:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970637.706943:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970637.706976:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.707009:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.707076:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368000 00000100:00100000:2.0:1788970637.707081:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368000 00000100:00100000:2.0:1788970637.707117:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788970637.707125:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+12:23444:x1875871102368000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970637.707134:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970637.707149:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c70390 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70389 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.707172:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c70390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70389 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.707195:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98200/0xc3abfebe76c70390 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70389 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.707204:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98200, rc 0) 00000100:00100000:2.0:1788970637.707243:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+13:23444:x1875871102368000:12345-0@lo:101:mount.lustre.0 Request processed in 119us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.707249:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788970637.707327:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970637.707339:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70390 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.707348:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70390 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970637.707363:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788970637.707410:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70390 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.707424:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4200/0xc3abfebe76c70389 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70390 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970637.707432:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a7d81a76800 10000000:01000000:3.0:1788970637.707435:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788970637.707439:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a7d81a76800 from 1 10000000:01000000:3.0:1788970637.707441:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788970637.707455:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.707462:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.707470:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970637.707481:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970637.707517:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.707537:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357840 going to sleep for 11 seconds 00000100:00100000:1.0:1788970637.707757:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368128 00000100:00100000:1.0:1788970637.707763:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368128 00000100:00100000:1.0:1788970637.707799:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788970637.707806:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+13:23444:x1875871102368128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970637.707814:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970637.707823:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c7039e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70397 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.707836:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c7039e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70397 expref: 14 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.707844:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b000/0xc3abfebe76c7039e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70397 expref: 14 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.707850:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b000, rc 0) 00000100:00100000:1.0:1788970637.707882:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+14:23444:x1875871102368128:12345-0@lo:101:mount.lustre.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.707889:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788970637.708036:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970637.708046:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7039e expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.708054:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7039e expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970637.708064:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788970637.708068:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7039e expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.708082:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4600/0xc3abfebe76c70397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7039e expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970637.708088:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788970637.708092:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970637.708097:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a7d81a76800 10000000:01000000:3.0:1788970637.708100:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788970637.708103:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788970637.708104:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788970637.708120:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.708126:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.708132:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970637.708144:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970637.708170:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.708199:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970637.708329:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368256 00000100:00100000:0.0:1788970637.708335:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368256 00000100:00100000:0.0:1788970637.708366:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970637.708373:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+14:23444:x1875871102368256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970637.708410:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970637.708421:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83025800/0xc3abfebe76c703ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c703a5 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.708448:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025800/0xc3abfebe76c703ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c703a5 expref: 15 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.708456:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83025800/0xc3abfebe76c703ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c703a5 expref: 15 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.708463:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025800, rc 0) 00000100:00100000:0.0:1788970637.708494:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368256:12345-0@lo:101:mount.lustre.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.708661:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970637.708671:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c703ac expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.708679:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c703ac expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970637.708811:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000040:00080000:2.0:1788970637.711136:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788970637.711964:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970637.720845:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788970637.720914:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788970637.720931:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788970637.720943:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788970637.720955:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788970637.720967:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788970637.720979:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788970637.720992:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788970637.721007:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788970637.721020:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788970637.721032:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788970637.721047:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788970637.721075:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788970637.721092:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788970637.721106:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788970637.721893:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788970637.721911:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788970637.721926:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788970637.721941:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788970637.721956:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788970637.721971:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788970637.721987:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788970637.722002:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788970637.722018:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788970637.722031:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788970637.722044:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788970637.722058:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788970637.722073:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788970637.722090:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788970637.722104:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788970637.722569:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788970637.722585:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788970637.722598:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788970637.722611:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788970637.722623:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788970637.722634:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788970637.722646:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788970637.722658:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788970637.722671:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788970637.722684:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788970637.722696:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788970637.722708:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788970637.722722:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788970637.723188:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788970637.723227:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788970637.723245:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788970637.723356:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.724237:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.724420:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.726143:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368384 00000100:00100000:3.0:1788970637.726157:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368384 00000100:00100000:3.0:1788970637.726221:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970637.726232:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.726603:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.726656:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970637.726718:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.726724:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368384:12345-0@lo:501:mount.lustre.0 Request processed in 491us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.726744:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788970637.727124:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368512 00000100:00100000:3.0:1788970637.727129:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368512 00000100:00100000:3.0:1788970637.727249:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788970637.727259:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970637.727262:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.728726:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368512:12345-0@lo:503:mount.lustre.0 Request processed in 1463us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.728749:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788970637.729117:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970637.730643:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970637.730767:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.730856:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.730900:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.731154:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368640 00000100:00100000:3.0:1788970637.731162:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368640 00000100:00100000:3.0:1788970637.731215:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788970637.731224:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.732367:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368640:12345-0@lo:502:mount.lustre.0 Request processed in 1137us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.732411:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970637.733094:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970637.733334:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788970637.733366:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788970637.733417:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788970637.733436:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788970637.733455:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788970637.733469:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788970637.733483:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788970637.733496:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788970637.733522:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788970637.733535:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788970637.733548:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788970637.733562:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788970637.733574:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788970637.733598:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788970637.733612:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788970637.733624:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788970637.733635:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788970637.733647:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788970637.733887:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788970637.733902:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788970637.733913:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788970637.733925:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788970637.733935:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788970637.733947:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788970637.733958:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788970637.733970:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788970637.733981:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788970637.733993:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788970637.734005:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788970637.734017:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788970637.734031:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788970637.734044:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788970637.734058:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788970637.734072:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788970637.734085:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788970637.734098:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788970637.734109:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788970637.734121:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788970637.734133:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788970637.734145:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788970637.734156:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788970637.734167:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788970637.734178:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788970637.734190:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788970637.734225:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.734293:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.734344:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.734531:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368768 00000100:00100000:3.0:1788970637.734539:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368768 00000100:00100000:3.0:1788970637.734596:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788970637.734605:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.734751:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102368768:12345-0@lo:502:mount.lustre.0 Request processed in 146us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.734759:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788970637.736236:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102368768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970637.736332:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788970637.736347:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788970637.738246:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970637.738261:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.738263:0:23448:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788970637.738270:0:23448:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788970637.738273:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970637.738486:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a7ebd8eb380) 00000020:00000080:2.0:1788970637.738587:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788970637.738597:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788970637.739987:0:23448:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788970637.739999:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c703ba 00000020:00000080:3.0:1788970637.740225:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788970637.740233:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970637.740249:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970637.740251:0:23448:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788970637.740255:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970637.740259:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970637.740261:0:23448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788970637.740265:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788970637.740345:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a7e84854d40) 00000020:00000080:3.0:1788970637.740362:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788970637.740369:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788970637.740371:0:23448:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788970637.740374:0:23448:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788970637.740561:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788970637.741213:0:23448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81a76800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788970637.741232:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a7e84853380) 00000020:00000080:3.0:1788970637.741244:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788970637.741576:0:23448:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788970637.741585:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c703cf 00000020:00000080:3.0:1788970637.741714:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788970637.741722:0:23448:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788970637.741725:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc3abfebe76c703d6 00080000:01000000:3.0:1788970637.741857:0:23448:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788970637.741864:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c703dd 00000100:00100000:1.0:1788970637.788663:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:2.0:1788970637.864138:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788970637.864678:0:23448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788970637.865041:0:23448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788970637.870411:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788970637.870425:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.870435:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.870437:0:23448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788970637.870442:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.870448:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.870449:0:23448:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788970637.870452:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970637.870457:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:00000080:0.0:1788970637.870490:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970637.870517:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a7eae093380) 00000020:00000080:0.0:1788970637.870541:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788970637.870546:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970637.870871:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788970637.870878:0:23448:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788970637.870886:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c703eb 00010000:00080000:0.0:1788970637.870917:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83d71800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970637.873267:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788970637.881294:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788970637.881310:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788970637.881359:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788970637.881575:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c703f2 00000100:00080000:3.0:1788970637.881587:0:23448:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970637.881598:0:23448:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a7d83d71800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970637.881847:0:23448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebba8ed00 x1875871102368896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970637.881923:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102368896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970637.881987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.882064:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102368896 00000100:00100000:1.0:1788970637.882072:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102368896 00000100:00100000:1.0:1788970637.882124:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970637.882131:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102368896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788970637.882161:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:1.0:1788970637.882199:0:22717:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c703f9 00000004:00100000:1.0:1788970637.882213:0:22717:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788970637.882219:0:22717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788970637.882350:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788970637.882482:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.882487:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882490:0:23448:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788970637.882493:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970637.882505:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788970637.882507:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970637.882509:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970637.882510:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970637.882514:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882515:0:23448:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970637.882518:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.882523:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882524:0:23448:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788970637.882528:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788970637.882587:0:23448:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788970637.882610:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.882613:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882614:0:23448:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788970637.882617:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970637.882619:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788970637.882620:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970637.882622:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970637.882623:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970637.882626:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882627:0:23448:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970637.882630:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970637.882633:0:23448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788970637.882636:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.882638:0:23448:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788970637.882640:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788970637.882644:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:0.0:1788970637.882670:0:23448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788970637.882673:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970637.882687:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a7eae0919c0) 00000020:00000080:0.0:1788970637.882700:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788970637.882704:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788970637.882911:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788970637.882918:0:23448:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788970637.882925:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c70407 00010000:00080000:0.0:1788970637.882951:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d81aca800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970637.883206:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788970637.884177:0:23448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788970637.884481:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788970637.885893:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970637.886092:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788970637.886240:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:1.0:1788970637.886842:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970637.886847:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788970637.886850:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970637.886858:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 656 00000100:00080000:1.0:1788970637.886864:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788970637.886875:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7d827af000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:1.0:1788970637.886896:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6c780 x1875871102369152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788970637.886918:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970637.886922:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970637.886925:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970637.886928:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970637.886967:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102369024:0@lo:400:kworker.0 00000100:00100000:1.0:1788970637.887035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.887075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970637.887080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102369280:0@lo:400:kworker.0 00000100:00100000:1.0:1788970637.887116:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.887151:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369024 00000100:00100000:1.0:1788970637.887157:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369024 00000100:00100000:1.0:1788970637.887198:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970637.887214:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:3649:x1875871102369024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970637.887263:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:3649:x1875871102369024:12345-0@lo:400:kworker.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.887271:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788970637.887304:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369280 00000100:00100000:1.0:1788970637.887308:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369280 00000100:00100000:1.0:1788970637.887340:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970637.887346:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102369280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970637.887375:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102369280:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.887532:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102369152:0@lo:38:kworker.0 00000100:00100000:0.0:1788970637.887562:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.887593:0:22716:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788970637.887600:0:22716:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:0.0:1788970637.887632:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7ebdb6da40 x1875871102369280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970637.887645:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102369280:0@lo:400:kworker.0 00000100:00100000:0.0:1788970637.887655:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102369024:0@lo:400:kworker.0 00000100:00100000:0.0:1788970637.888129:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369152 00000100:00100000:0.0:1788970637.888134:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369152 00000100:00100000:3.0:1788970637.888548:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970637.888554:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102369152:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788970637.888621:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875871102369152:12345-0@lo:38:kworker.0 Request processed in 64us (1057us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788970637.888627:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970637.888692:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970637.888799:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970637.888806:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788970637.888811:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788970637.888821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102369152:0@lo:38:kworker.0 00000040:00080000:0.0:1788970637.890012:0:23453:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788970637.890019:0:23453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788970637.890709:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970637.890721:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788970637.890759:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788970637.890780:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c7040e 00000100:00080000:2.0:1788970637.890789:0:23448:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970637.890799:0:23448:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7d81aca800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970637.890833:0:23448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf612c0 x1875871102369408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970637.890883:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788970637.890937:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970637.890941:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.890943:0:23448:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788970637.890954:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788970637.890957:0:23448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788970637.890958:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970637.890960:0:23448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788970637.890961:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788970637.890964:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.890965:0:23448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788970637.890968:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970637.890972:0:23448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788970637.890975:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.890976:0:23448:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788970637.890979:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788970637.890983:0:23448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.115@tcp to nid 0x20000c0a8cb73 (192.168.203.115@tcp) 00000020:01000000:2.0:1788970637.891004:0:23448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788970637.891007:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970637.891017:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a7ebd8e99c0) 00000020:00000080:2.0:1788970637.891030:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788970637.891034:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788970637.891092:0:23448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788970637.891098:0:23448:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788970637.891103:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc3abfebe76c7041c 00000100:00100000:0.0:1788970637.891459:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102369408:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788970637.891515:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102369408 offset 0 length 520: 4 00000100:00080000:0.0:1788970637.891583:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970637.891588:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970637.891591:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970637.891594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1788970637.891691:0:23448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebb910000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970637.891902:0:23448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788970637.891968:0:23448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788970637.891984:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788970637.894213:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970637.894611:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788970637.894749:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788970637.895053:0:23456:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788970637.895059:0:23456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788970637.895829:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788970637.895841:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788970637.895877:0:23448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788970637.895897:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c70423 00000100:00080000:2.0:1788970637.895906:0:23448:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970637.895921:0:23448:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebb910000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970637.895956:0:23448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf62d00 x1875871102369536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970637.896016:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102369536:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788970637.896069:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102369536 offset 0 length 520: 4 00000100:00080000:2.0:1788970637.896135:0:23448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788970637.896180:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970637.896184:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.896186:0:23448:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788970637.896188:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970637.896192:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.896193:0:23448:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788970637.896196:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788970637.896198:0:23448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788970637.896200:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970637.896202:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.896204:0:23448:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788970637.896206:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788970637.896208:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.896209:0:23448:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788970637.896212:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788970637.896234:0:23448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788970637.896237:0:23448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970637.896238:0:23448:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788970637.896241:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1788970637.896351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970637.896356:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970637.896358:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970637.896361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788970637.896434:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788970637.896462:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788970637.896480:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c703ac expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.896507:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4c00/0xc3abfebe76c703a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c703ac expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970637.896516:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d81a76800 from 1 10000000:01000000:2.0:1788970637.896519:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970637.896545:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.896553:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.896564:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970637.896581:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102369664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970637.896620:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.896638:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.896970:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369664 00000100:00100000:3.0:1788970637.896977:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369664 00000100:00100000:3.0:1788970637.897027:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970637.897037:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+15:23444:x1875871102369664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970637.897048:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970637.897060:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c7042a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.897081:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.897091:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.897099:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f4800, rc 0) 00000100:00100000:3.0:1788970637.897255:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:23444:x1875871102369664:12345-0@lo:101:mount.lustre.0 Request processed in 219us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.897261:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970637.897343:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102369664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970637.897357:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.897366:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970637.898290:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102369792:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788970637.898338:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.898432:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c950c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788970637.898745:0:22717:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf423000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970637.898807:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102368896:12345-0@lo:38:llog_process_th.0 Request processed in 16675us (16819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.898818:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970637.898907:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788970637.898915:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788970637.898924:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788970637.898929:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788970637.898932:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83d71800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788970637.898950:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102368896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970637.899078:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102369920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970637.899135:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.899166:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369920 00000100:00100000:3.0:1788970637.899172:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369920 00000100:00100000:3.0:1788970637.899209:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970637.899217:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102369920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970637.899277:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788970637.899314:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875871102369920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.899320:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970637.899349:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102369920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970637.899652:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102369792 00000100:00100000:1.0:1788970637.899658:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102369792 00000100:00100000:1.0:1788970637.899724:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970637.899732:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:23444:x1875871102369792:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788970637.899746:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788970637.899764:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788970637.899767:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788970637.899856:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:23444:x1875871102369792:12345-0@lo:256:mount.lustre.0 Request processed in 125us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.899863:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788970637.899946:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102369792:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788970637.900655:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788970637.900676:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.900687:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970637.900695:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81a76800 from 1 10000000:01000000:2.0:1788970637.900698:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970637.900724:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.900732:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.900741:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970637.900759:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970637.900802:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.901218:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.901288:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370048 00000100:00100000:3.0:1788970637.901294:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370048 00000100:00100000:3.0:1788970637.901326:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970637.901333:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:23444:x1875871102370048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970637.901342:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970637.901355:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70438 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.901377:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.901419:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.901427:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5200, rc 0) 00000100:00100000:3.0:1788970637.901465:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370048:12345-0@lo:101:mount.lustre.0 Request processed in 131us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.901480:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788970637.901616:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970637.901630:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.901640:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970637.902617:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788970637.902968:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970637.903125:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788970637.903152:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788970637.903167:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788970637.903182:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788970637.903197:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788970637.903210:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788970637.903224:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788970637.903238:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788970637.903254:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788970637.903286:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788970637.903302:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788970637.903326:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788970637.903332:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788970637.903481:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.903558:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.903596:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.903772:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370176 00000100:00100000:3.0:1788970637.903778:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370176 00000100:00100000:3.0:1788970637.903856:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970637.903866:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970637.903975:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370176:12345-0@lo:501:mount.lustre.0 Request processed in 111us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.903982:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970637.904053:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.904082:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970637.904318:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.904660:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970637.904709:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370304 00000100:00100000:0.0:1788970637.904714:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370304 00000100:00100000:0.0:1788970637.904741:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970637.904748:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970637.904893:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370304:12345-0@lo:503:mount.lustre.0 Request processed in 145us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.904900:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970637.905185:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370304:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970637.905688:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970637.905756:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.905818:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.905861:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970637.906190:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370432 00000100:00100000:0.0:1788970637.906196:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370432 00000100:00100000:0.0:1788970637.906230:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970637.906238:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970637.906330:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370432:12345-0@lo:502:mount.lustre.0 Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.906337:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970637.906693:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970637.906868:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788970637.906897:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788970637.906915:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788970637.906929:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788970637.906944:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788970637.906960:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788970637.906974:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788970637.906988:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788970637.907001:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788970637.907015:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788970637.907029:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788970637.907066:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.907113:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.907144:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.907216:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370560 00000100:00100000:3.0:1788970637.907221:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370560 00000100:00100000:3.0:1788970637.907257:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970637.907265:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.907353:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370560:12345-0@lo:502:mount.lustre.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.907360:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788970637.907549:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970637.907601:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788970637.907610:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788970637.912490:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.912513:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912516:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788970637.912524:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81a76800 00000020:00000080:0.0:1788970637.912527:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970637.912535:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.912538:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912539:0:23458:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788970637.912541:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.912544:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912545:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788970637.912548:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d81a76800 00000020:00000080:0.0:1788970637.912550:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970637.912609:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.912613:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912615:0:23458:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788970637.912617:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.912619:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912620:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970637.912624:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81a76800 00000020:00000080:0.0:1788970637.912626:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970637.912644:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.912646:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912648:0:23458:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970637.912650:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970637.912664:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912665:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788970637.912669:0:23458:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d81a76800 00000020:00000080:0.0:1788970637.912670:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970637.912693:0:23458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970637.912695:0:23458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970637.912696:0:23458:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788970637.912699:0:23458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788970637.913648:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788970637.913686:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970637.913713:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.913725:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970637.913780:0:23444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970637.913783:0:23444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7d81a76800 10000000:01000000:3.0:1788970637.913786:0:23444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7d81a76800 10000000:01000000:3.0:1788970637.913791:0:23444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970637.913802:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d81a76800 from 1 10000000:01000000:3.0:1788970637.913805:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970637.913840:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.913848:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970637.913859:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970637.913883:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970637.913955:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.914003:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7427300 going to sleep for 11 seconds 00000100:00100000:1.0:1788970637.914099:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370688 00000100:00100000:1.0:1788970637.914106:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370688 00000100:00100000:1.0:1788970637.914154:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788970637.914163:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:23444:x1875871102370688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970637.914177:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970637.914191:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ae00/0xc3abfebe76c7044d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70446 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.914222:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ae00/0xc3abfebe76c7044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70446 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.914233:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9ae00/0xc3abfebe76c7044d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70446 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.914242:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ae00, rc 0) 00000100:00100000:1.0:1788970637.914291:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102370688:12345-0@lo:101:mount.lustre.0 Request processed in 129us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.914298:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788970637.914375:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970637.914417:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7044d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970637.914426:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7044d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970637.927614:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788970637.927906:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970637.928108:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788970637.928143:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788970637.928158:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788970637.928186:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788970637.928201:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788970637.928213:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788970637.928226:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788970637.928239:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788970637.928252:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788970637.928265:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788970637.928278:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788970637.928292:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788970637.928305:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788970637.928319:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788970637.928333:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788970637.928348:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788970637.928362:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788970637.928376:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788970637.928430:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788970637.928460:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788970637.928477:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788970637.928491:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788970637.928519:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788970637.928539:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788970637.928553:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788970637.928566:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788970637.928579:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788970637.928592:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788970637.928606:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788970637.928618:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788970637.928632:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788970637.928645:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788970637.928657:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788970637.928670:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788970637.928693:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788970637.928717:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788970637.928732:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788970637.928744:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788970637.928757:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788970637.928770:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788970637.928783:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788970637.928796:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788970637.928810:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788970637.928823:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788970637.928835:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788970637.928847:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788970637.928860:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788970637.928872:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788970637.928977:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788970637.928998:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788970637.929027:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788970637.929033:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788970637.929110:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970637.929182:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970637.929228:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970637.930031:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370816 00000100:00100000:0.0:1788970637.930040:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370816 00000100:00100000:0.0:1788970637.930097:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788970637.930116:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102370816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970637.930264:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102370816:12345-0@lo:501:mount.lustre.0 Request processed in 159us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.930271:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788970637.930567:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970637.930852:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970637.930901:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.930939:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea74276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.931001:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102370944 00000100:00100000:2.0:1788970637.931006:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102370944 00000100:00100000:2.0:1788970637.931037:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788970637.931045:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102370944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970637.931121:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102370944:12345-0@lo:503:mount.lustre.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.931128:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788970637.931333:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102370944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970637.931964:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970637.932033:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.932075:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.932096:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea74276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.932221:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371072 00000100:00100000:2.0:1788970637.932227:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371072 00000100:00100000:2.0:1788970637.932264:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788970637.932271:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.932351:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371072:12345-0@lo:502:mount.lustre.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.932358:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788970637.933078:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970637.933270:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788970637.933296:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788970637.933310:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788970637.933330:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788970637.933343:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788970637.933354:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788970637.933364:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788970637.933376:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788970637.933421:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788970637.933434:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788970637.933446:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788970637.933457:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788970637.933481:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788970637.933494:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788970637.933521:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788970637.933532:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788970637.933543:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788970637.933556:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788970637.933566:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788970637.933577:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788970637.933588:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788970637.933599:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788970637.933609:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788970637.933621:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788970637.933632:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788970637.933643:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788970637.933654:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788970637.933665:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788970637.933687:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788970637.933700:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788970637.933713:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788970637.933724:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788970637.933734:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788970637.933745:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788970637.933756:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788970637.933766:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788970637.933786:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788970637.933798:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788970637.933809:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788970637.933820:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788970637.933831:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788970637.933843:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788970637.933854:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788970637.933865:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788970637.933887:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788970637.933903:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788970637.933915:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788970637.933928:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788970637.933974:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.934034:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.934065:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea74276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.934644:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371200 00000100:00100000:2.0:1788970637.934652:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371200 00000100:00100000:2.0:1788970637.934694:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788970637.934702:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.934808:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371200:12345-0@lo:502:mount.lustre.0 Request processed in 106us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.934816:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788970637.935051:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970637.935224:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788970637.935249:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788970637.935275:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970637.935312:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.935345:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea74276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.935505:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371328 00000100:00100000:2.0:1788970637.935510:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371328 00000100:00100000:2.0:1788970637.935549:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788970637.935556:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970637.935758:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371328:12345-0@lo:502:mount.lustre.0 Request processed in 202us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.935765:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788970637.935847:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970637.935888:0:23444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788970637.935896:0:23444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788970637.944738:0:23463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788970637.944758:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a7d81ae99c0) 00000020:00000080:0.0:1788970637.944782:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788970637.944884:0:23463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d81a76800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788970637.944888:0:23463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d81a76800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788970637.944891:0:23463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d81a76800 3 00010000:00080000:0.0:1788970637.944921:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7ebf423800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970637.946647:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788970637.946841:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788970637.946876:0:23463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970637.946888:0:23463:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc3abfebe76c7045b 00000100:00080000:0.0:1788970637.946897:0:23463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970637.946907:0:23463:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a7ebf423800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970637.946941:0:23463:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebba8ed00 x1875871102371456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970637.946977:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788970637.947808:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102371456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788970637.947877:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788970637.947939:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970637.947944:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970637.947948:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970637.947951:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970637.948196:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371456 00000100:00100000:3.0:1788970637.948204:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371456 00000040:00080000:2.0:1788970637.948330:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:3.0:1788970637.948509:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788970637.948516:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102371456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788970637.948550:0:22711:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:3.0:1788970637.948753:0:22711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc3abfebe76c70462 00000004:00100000:3.0:1788970637.948769:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788970637.948804:0:22711:0:(import.c:65:import_set_state_nolock()) ffff8a7d8370c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970637.948913:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875871102371456:12345-0@lo:38:llog_process_th.0 Request processed in 395us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.948920:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788970637.948978:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7ebba8ed00 x1875871102371456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970637.948988:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970637.948996:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788970637.949003:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788970637.949007:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788970637.949010:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf423800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970637.949015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875871102371456:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788970637.950367:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788970637.950560:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788970637.951724:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7044d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.951741:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7ec21f4a00/0xc3abfebe76c70446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7044d expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788970637.951807:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788970637.951810:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788970637.951811:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970637.951812:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970637.951814:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970637.951815:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970637.951816:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970637.951818:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970637.951819:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970637.951823:0:23444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788970637.951826:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788970637.951827:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788970637.951828:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970637.951834:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970637.951835:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970637.951836:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970637.951837:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970637.951838:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970637.951839:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788970637.951864:0:23444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788970637.951883:0:23444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371584:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788970637.951958:0:23444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.952736:0:23444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.956508:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371584 00000100:00100000:2.0:1788970637.956525:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371584 00000100:00100000:2.0:1788970637.956595:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788970637.956606:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:23444:x1875871102371584:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970637.956638:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788970637.956651:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788970637.961132:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788970637.961203:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970637.961220:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788970637.961313:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788970637.961318:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788970637.961340:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961358:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961366:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961373:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961429:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961442:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 18 pid: 22705 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970637.961455:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102371712:0@lo:104: 00000100:00100000:1.0:1788970637.961522:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970637.961571:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961580:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 18 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970637.961588:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102371840:0@lo:104: 00000100:00100000:1.0:1788970637.961608:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.961625:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970637.961659:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371712 00000100:00100000:1.0:1788970637.961666:0:22695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371712 00000100:00100000:1.0:1788970637.961694:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371840 00000100:00100000:1.0:1788970637.961696:0:22695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371840 00000100:00100000:1.0:1788970637.961706:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970637.961713:0:22695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102371712:12345-0@lo:104: 00010000:00010000:1.0:1788970637.961724:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961767:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970637.961771:0:22695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102371712:12345-0@lo:104: Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.961778:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970637.961792:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970637.961797:0:22695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102371840:12345-0@lo:104: 00010000:00010000:1.0:1788970637.961804:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961831:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788970637.961835:0:22695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102371840:12345-0@lo:104: Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.961846:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788970637.961861:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970637.961866:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961873:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99c00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970637.961877:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961885:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970637.961892:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970637.961897:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970637.961924:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961930:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970637.961958:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961965:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99c00/0xc3abfebe76c7042a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70431 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961974:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970637.961977:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.961992:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970637.961996:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962003:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970637.962010:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970637.962015:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970637.962029:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962035:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788970637.962045:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102371968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970637.962047:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962053:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c70366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7036d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962065:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970637.962067:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970637.962069:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970637.962073:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970637.962075:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970637.962087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102372096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970637.962109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970637.962141:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102371968 00000100:00100000:1.0:1788970637.962145:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102371968 00010000:00010000:1.0:1788970637.962168:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 19 pid: 22705 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970637.962196:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372096 00000100:00100000:1.0:1788970637.962199:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372096 00010000:00010000:1.0:1788970637.962209:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 20 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970637.962220:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970637.962226:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:3652:x1875871102371968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970637.962235:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970637.962240:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 20 pid: 22705 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962250:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 20 pid: 22705 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.962263:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970637.962273:0:22698:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788970637.962291:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:3652:x1875871102371968:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970637.962291:0:22698:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788970637.962297:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970637.962462:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:23444:x1875871102371584:12345-0@lo:253:mount.lustre.0 Request processed in 5857us (10503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.962470:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788970637.966586:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970637.966606:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3649:x1875871102372096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970637.966625:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970637.966635:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 18 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966650:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 18 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966686:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966694:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788970637.966709:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005391432s 00010000:00010000:1.0:1788970637.966713:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966720:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966727:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966734:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966740:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970637.966745:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966754:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966762:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970637.966772:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970637.966847:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3649:x1875871102372096:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (4736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.966861:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970637.966917:0:23444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:23444:1875871102371584:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788970637.966932:0:23444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788970637.966935:0:23444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788970637.966937:0:23444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788970637.966938:0:23444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788970637.966940:0:23444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788970637.966941:0:23444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788970637.966942:0:23444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788970637.966944:0:23444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788970637.966946:0:23444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788970637.966947:0:23444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788970637.966964:0:23444:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788970637.974680:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102372096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970637.975353:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102371968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970637.975486:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f4800/0xc3abfebe76c70431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c7042a expref: 17 pid: 22705 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970637.975519:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102371712:0@lo:104: 00010000:00010000:0.0:1788970637.975532:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c7036d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70366 expref: 16 pid: 22704 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970637.975541:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102371840:0@lo:104: 00010000:00010000:0.0:1788970637.975560:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.975705:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.975714:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970637.975721:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c70469 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788970637.976326:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788970637.976596:0:23470:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788970637.976600:0:23470:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788970637.976736:0:23471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788970637.977084:0:23471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788970637.977182:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788970637.980926:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970637.980993:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970637.981023:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82bf59c0 going to sleep for 11 seconds 00000040:01000000:1.0:1788970637.981170:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788970637.981203:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788970637.981684:0:23444:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788970637.981691:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788970637.981729:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970637.982726:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788970637.983248:0:23444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788970637.983282:0:23444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788970637.983371:0:23444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788970637.984113:0:23444:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:2.0:1788970637.985971:0:23471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788970637.986045:0:23471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788970637.986259:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372224 00000100:00100000:1.0:1788970637.986269:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372224 00000100:00100000:1.0:1788970637.986361:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970637.986371:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372224:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788970637.986693:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372224:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 323us (5698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.986710:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:1.0:1788970637.988249:0:23444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788970637.988360:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372224:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788970637.988691:0:23472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788970637.989347:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788970637.989491:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.989534:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb14940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970637.989745:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372352 00000100:00100000:2.0:1788970637.989753:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372352 00000100:00100000:2.0:1788970637.990030:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970637.990039:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788970637.990189:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 151us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970637.990195:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970637.990261:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788970637.990330:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875871102372480:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788970637.990358:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.990408:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82668b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970637.990555:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372480 00000100:00100000:1.0:1788970637.990560:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372480 00000100:00100000:1.0:1788970637.990603:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788970637.990611:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875871102372480:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788970637.990650:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875871102372480:12345-0@lo:900:lod0001_rec0000.0 Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970637.990657:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788970637.990729:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a7ebba8e940 x1875871102372480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970653 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970637.990740:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875871102372480:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788970637.990786:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788970637.990812:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970637.990992:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82e6fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970637.991048:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372608 00000100:00100000:3.0:1788970637.991054:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372608 00000100:00100000:3.0:1788970637.991078:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788970637.991085:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788970637.991189:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23472:x1875871102372608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970637.991195:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970637.991309:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8e940 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23472:1875871102372608:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788970637.991359:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970637.994226:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788970637.994307:0:23472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788970637.994313:0:23472:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788970638.002677:0:23444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788970638.002720:0:23444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa287c0d87988 00100000:10000000:1.0:1788970638.002730:0:23444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788970638.003868:0:23444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788970638.003906:0:23444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788970638.003928:0:23444:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788970638.003954:0:23444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788970638.010334:0:23444:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970638.010630:0:23444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788970638.429697:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970638.813426:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000040:00080000:2.0:1788970639.005201:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788970639.457199:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970639.774138:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788970639.836629:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 10000000:01000000:0.0:1788970639.836886:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970639.836890:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d81a76800 from 12 10000000:01000000:0.0:1788970639.836894:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970639.836943:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970639.836955:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970639.836987:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970639.837013:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970639.837086:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970639.837147:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82160780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970639.837155:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372736 00000100:00100000:1.0:1788970639.837163:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372736 00000100:00100000:1.0:1788970639.837222:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788970639.837233:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:22708:x1875871102372736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970639.837258:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970639.837274:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70470 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.837302:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.837325:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.837335:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a200, rc 0) 00000100:00100000:1.0:1788970639.837418:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102372736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970639.837426:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970639.837535:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970639.837550:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970639.837572:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970639.837625:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970639.837655:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970639.837787:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82160780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970639.839942:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372864 00000100:00100000:3.0:1788970639.839957:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372864 00000100:00100000:3.0:1788970639.840063:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788970639.840081:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102372864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788970639.840106:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788970639.840124:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788970639.840126:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788970639.840276:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102372864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970639.840284:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788970639.840378:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788970639.840476:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970639.840496:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.840506:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970639.840516:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970639.840519:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d827a9000 from 12 10000000:01000000:1.0:1788970639.840522:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970639.840552:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.840803:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.840814:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970639.840834:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970639.840875:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970639.847810:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82163600 going to sleep for 11 seconds 00000100:00100000:1.0:1788970639.847846:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102372992 00000100:00100000:1.0:1788970639.847856:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102372992 00000100:00100000:1.0:1788970639.847916:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970639.847925:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102372992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970639.847942:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970639.847961:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c7047e expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.847989:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.848000:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.848008:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9aa00, rc 0) 00000100:00100000:1.0:1788970639.848188:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102372992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (7311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970639.848196:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788970639.848250:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102372992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970639.848268:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.848276:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970639.848346:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102373120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970639.848421:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970639.848434:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82163600 going to sleep for 11 seconds 00000100:00100000:0.0:1788970639.848522:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373120 00000100:00100000:0.0:1788970639.848528:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373120 00000100:00100000:0.0:1788970639.848559:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788970639.848567:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102373120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970639.848581:0:22704:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970639.849004:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970639.849008:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788970639.849116:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102373120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 549us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970639.849125:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788970639.849152:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102373120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788970639.849203:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788970639.849212:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970639.849222:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970640.030659:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970640.479966:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970640.860662:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00010000:00010000:1.0:1788970641.503061:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970641.885458:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000001:02000400:0.0:1788970642.024937:0:23714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788970642.527284:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970642.836220:0:23767:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970642.836838:0:23767:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788970642.908484:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 0 seconds 00000100:00100000:0.0:1788970643.228621:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970643.228645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102373248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970643.228762:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970643.228848:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373248 00000100:00100000:3.0:1788970643.228855:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373248 00000100:00100000:3.0:1788970643.228909:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788970643.228918:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102373248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970643.228965:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788970643.229013:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102373248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970643.229020:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970643.230194:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102373248:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788970643.230805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788970643.230811:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788970643.230814:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788970643.230827:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a7d827af000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970643.230842:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102373376:0@lo:400:kworker.0 00000100:00100000:1.0:1788970643.230853:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebdb6f840 x1875871102373504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970643.230896:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970643.230964:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373376 00000100:00100000:0.0:1788970643.230971:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373376 00000100:00100000:0.0:1788970643.231011:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970643.231019:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3651:x1875871102373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970643.231071:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3651:x1875871102373376:12345-0@lo:400:kworker.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970643.231078:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788970643.231117:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102373376:0@lo:400:kworker.0 00000100:00080000:1.0:1788970643.231486:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970643.231490:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970643.231528:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970643.231532:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970643.231554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970643.231570:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788970643.231573:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788970643.231575:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788970643.231607:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970643.231617:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102373760:0@lo:400:kworker.0 00000100:00100000:1.0:1788970643.231656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970643.231689:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373760 00000100:00100000:1.0:1788970643.231694:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373760 00000100:00100000:1.0:1788970643.231726:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970643.231734:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102373760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970643.231771:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875871102373760:12345-0@lo:400:kworker.0 Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970643.231778:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788970643.231810:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebdb6e1c0 x1875871102373760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970643.231820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875871102373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788970643.232032:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788970643.232076:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970643.232369:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102373504:0@lo:38:kworker.0 00000100:00100000:3.0:1788970643.232477:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970643.232655:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373504 00000100:00100000:0.0:1788970643.232661:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373504 00000100:00100000:0.0:1788970643.232738:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970643.232744:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875871102373504:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788970643.232773:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1788970643.232806:0:22717:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c7048c 00000004:00100000:0.0:1788970643.232829:0:22717:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788970643.232835:0:22717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788970643.232958:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373632 00000100:00100000:1.0:1788970643.232964:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373632 00000100:00100000:1.0:1788970643.233005:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970643.233013:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970643.233069:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102373632:12345-0@lo:400:kworker.0 Request processed in 57us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970643.233075:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788970643.233145:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebdb6d680 x1875871102373632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970643.233157:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102373632:0@lo:400:kworker.0 00000100:00080000:0.0:1788970643.255623:0:22717:0:(import.c:65:import_set_state_nolock()) ffff8a7e957f6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970643.255719:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102373504:12345-0@lo:38:kworker.0 Request processed in 22972us (23239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970643.255730:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788970643.255884:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788970643.255894:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788970643.255899:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788970643.255902:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d827af000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788970643.255923:0:3648:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002174bc1e): req@ffff8a7ebdb6c3c0 x1875871102366336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970643.255946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102373504:0@lo:38:kworker.0 00000100:00100000:3.0:1788970643.256086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102373888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970643.256121:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970643.256256:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102373888 00000100:00100000:1.0:1788970643.256263:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102373888 00000100:00100000:1.0:1788970643.256315:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970643.256324:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102373888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970643.256351:0:23454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970643.256425:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875871102373888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970643.256431:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788970643.256612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102373888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970643.256725:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970643.256750:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494000 going to sleep for 11 seconds 00000100:00100000:3.0:1788970643.256809:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102366336 00000100:00100000:3.0:1788970643.256813:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102366336 00000100:00100000:3.0:1788970643.256843:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788970643.256859:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102366336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788970643.256923:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102366336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970643.256930:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970643.256996:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6c3c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1875871102366336:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788970643.257028:0:22753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788970643.257064:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1875871102374016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788970643.257093:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970643.257509:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970643.264616:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374016 00000100:00100000:3.0:1788970643.264633:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374016 00000100:00100000:3.0:1788970643.264685:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970643.264695:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102374016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788970643.264859:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102374016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 166us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970643.264867:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970643.269344:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1875871102374016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788970643.269729:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1875871102374144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788970643.269791:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970643.269876:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970643.270950:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374144 00000100:00100000:3.0:1788970643.270960:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374144 00000100:00100000:3.0:1788970643.271047:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970643.271057:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102374144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788970643.271164:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875871102374144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970643.271181:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788970643.271243:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1875871102374144:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788970643.271300:0:22753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970643.273446:0:22753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788970643.273542:0:22753:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 16, retries 0 00000004:00080000:1.0:1788970643.273547:0:22753:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788970643.551160:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970643.744918:0:23817:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970643.745211:0:23817:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970644.579178:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788970644.586935:0:23865:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffa8e73f0 20000000:00000080:3.0:1788970644.586953:0:23865:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7e8e61c400 uarg=0000000000000000 20000000:01000000:3.0:1788970644.586991:0:23865:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788970644.586998:0:23865:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788970644.587002:0:23865:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788970644.589780:0:23866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788970644.590099:0:23865:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788970644.598045:0:23865:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788970644.601966:0:23865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.602004:0:23865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.602012:0:23865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.602019:0:23865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.602065:0:23865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.602079:0:23865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 17 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970644.603433:0:23865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23865:1875871102374272:0@lo:104: 00000100:00100000:3.0:1788970644.603545:0:23865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788970644.603619:0:23865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.603631:0:23865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970644.603640:0:23865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23865:1875871102374400:0@lo:104: 00000100:00100000:3.0:1788970644.603659:0:23865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970644.603704:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374272 00000100:00100000:3.0:1788970644.603712:0:22695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374272 00000100:00100000:3.0:1788970644.603754:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374400 00000100:00100000:3.0:1788970644.603757:0:22695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374400 00000100:00100000:3.0:1788970644.603839:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970644.603846:0:22695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:23865:x1875871102374272:12345-0@lo:104: 00010000:00010000:3.0:1788970644.603923:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.603971:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788970644.603976:0:22695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:23865:x1875871102374272:12345-0@lo:104: Request processed in 131us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970644.603983:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970644.603999:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970644.604004:0:22695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:23865:x1875871102374400:12345-0@lo:104: 00010000:00010000:3.0:1788970644.604011:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.604033:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788970644.604037:0:22695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:23865:x1875871102374400:12345-0@lo:104: Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970644.604042:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970644.604060:0:23865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e90b18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970644.604080:0:23865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23865:1875871102374272:0@lo:104: 00000100:00100000:3.0:1788970644.604087:0:23865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23865:1875871102374400:0@lo:104: 00010000:00010000:3.0:1788970644.604106:0:23865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604463:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970644.604471:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604491:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970644.604495:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604503:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970644.604509:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970644.604515:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970644.604553:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604560:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970644.604581:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604589:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99200/0xc3abfebe76c70438 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7043f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604601:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970644.604604:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604609:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970644.604611:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604630:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970644.604637:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970644.604643:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970644.604658:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604663:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970644.604669:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604676:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c70335 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7033c expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.604770:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970644.604772:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970644.604774:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970644.604789:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102374528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970644.604830:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970644.604857:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970644.604865:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102374656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970644.604883:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970644.604915:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374528 00000100:00100000:0.0:1788970644.604920:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374528 00010000:00010000:0.0:1788970644.604945:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 18 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970644.604984:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374656 00000100:00100000:0.0:1788970644.604988:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374656 00010000:00010000:0.0:1788970644.605002:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 19 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970644.605022:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970644.605030:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:3651:x1875871102374528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970644.605041:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970644.605048:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 19 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605059:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 19 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605073:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7043f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70438 expref: 19 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605087:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970644.605120:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3651:x1875871102374528:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970644.605126:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970644.605141:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970644.605147:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:3651:x1875871102374656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970644.605154:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970644.605157:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605165:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605181:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ba00/0xc3abfebe76c7033c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70335 expref: 17 pid: 22704 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605191:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605199:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605212:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605219:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605225:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605230:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605235:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7ec21f5400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970644.605239:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605246:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605257:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970644.605276:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970644.605299:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:3651:x1875871102374656:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970644.605306:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788970644.605339:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102374656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970644.605459:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102374528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970644.605493:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970644.606029:0:23865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.606039:0:23865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970644.606054:0:23865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c70493 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970645.598793:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788970645.661661:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970645.661669:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81a76800 from 13 10000000:01000000:1.0:1788970645.661673:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970645.661724:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.661737:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.661749:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970645.661776:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102374784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.661840:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.661922:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:3.0:1788970645.662048:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374784 00000100:00100000:3.0:1788970645.662055:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374784 00000100:00100000:3.0:1788970645.662107:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788970645.662116:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+16:22708:x1875871102374784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970645.662129:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970645.662143:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c7049a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970645.662167:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970645.662178:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970645.662186:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5400, rc 0) 00000100:00100000:3.0:1788970645.662234:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102374784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970645.662241:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788970645.662326:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102374784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970645.662367:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.662376:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970645.662595:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.662623:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.662645:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970645.662728:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102374912 00000100:00100000:2.0:1788970645.662733:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102374912 00000100:00100000:2.0:1788970645.662758:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788970645.662765:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102374912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970645.662872:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102374912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970645.662879:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788970645.662945:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.662971:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.663008:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.663034:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970645.663075:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375040 00000100:00100000:2.0:1788970645.663080:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375040 00000100:00100000:2.0:1788970645.663097:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788970645.663103:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102375040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970645.663184:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102375040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970645.663200:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788970645.663307:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788970645.664305:0:23926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788970645.665736:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788970645.665766:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788970645.665777:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.665790:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970645.665801:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788970645.665804:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d827a9000 from 13 10000000:01000000:1.0:1788970645.665806:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788970645.665845:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.665871:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.665883:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970645.665906:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.665965:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.666007:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970645.666118:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375168 00000100:00100000:2.0:1788970645.666126:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375168 00000100:00100000:2.0:1788970645.666182:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788970645.666193:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+17:22708:x1875871102375168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970645.666207:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970645.666220:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c704a8 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970645.666245:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970645.666255:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 18 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970645.666264:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99400, rc 0) 00000100:00100000:2.0:1788970645.666312:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102375168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970645.666318:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788970645.666721:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970645.666737:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970645.666746:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970645.666802:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.666828:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.666859:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:0.0:1788970645.666921:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375296 00000100:00100000:0.0:1788970645.666926:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375296 00000100:00100000:0.0:1788970645.666998:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788970645.667006:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102375296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970645.667130:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102375296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970645.667137:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788970645.667198:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.667226:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970645.667270:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970645.668008:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaef98900 going to sleep for 11 seconds 00000100:00100000:2.0:1788970645.668097:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375424 00000100:00100000:2.0:1788970645.668104:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375424 00000100:00100000:2.0:1788970645.668137:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788970645.668145:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102375424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970645.668255:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:22708:x1875871102375424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970645.668263:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788970645.668457:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102375424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970645.669334:0:23927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788970645.669676:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788970645.669703:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970645.669713:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970645.669726:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970646.620518:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970647.327333:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970637/real 1788970637] req@ffff8a7ebcf62d00 x1875871102369536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970647.327364:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebcf62d00 x1875871102369536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970647.327375:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970637/real 1788970637] req@ffff8a7ebcf612c0 x1875871102369408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970647.327413:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7ebcf612c0 x1875871102369408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970647.327444:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970647.327473:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970647.327477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102369536:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788970647.327483:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d81aca800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970647.327489:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970647.327491:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102369408:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788970647.328340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970647.328345:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970647.328372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970647.328376:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788970647.328418:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970647.328422:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788970647.328425:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a7d81aca800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970647.328442:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:3.0:1788970647.328447:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970647.328457:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7d81aca800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970647.328479:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830e8b40 x1875871102376064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970647.328493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970647.328503:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970647.328505:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970647.328509:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 657 00000100:00080000:3.0:1788970647.328512:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788970647.328517:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebb910000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970647.328529:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830ea580 x1875871102376192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970647.328565:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102375552:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.328625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970647.328665:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102376320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.328694:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970647.328716:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788970647.328722:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102375680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.328745:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970647.328772:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102375808:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.328793:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970647.328809:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970647.328814:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102375936:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.328849:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970647.328874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102376064:0@lo:8:kworker.0 00000400:00000100:3.0:1788970647.328895:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102376064 offset 0 length 520: 4 00000100:00100000:3.0:1788970647.328906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102376192:0@lo:8:kworker.0 00000400:00000100:3.0:1788970647.328921:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875871102376192 offset 0 length 520: 4 00000100:00100000:3.0:1788970647.328945:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375552 00000100:00100000:3.0:1788970647.328956:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375552 00000100:00100000:3.0:1788970647.328996:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970647.329003:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3649:x1875871102375552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329045:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:3649:x1875871102375552:12345-0@lo:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970647.329052:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788970647.329079:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376320 00000100:00100000:3.0:1788970647.329083:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376320 00000100:00100000:3.0:1788970647.329105:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375808 00000100:00100000:3.0:1788970647.329107:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375808 00000100:00100000:3.0:1788970647.329120:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970647.329125:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102376320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329152:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102376320:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970647.329159:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970647.329170:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970647.329175:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102375808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329201:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102375808:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970647.329207:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970647.329236:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375680 00000100:00100000:3.0:1788970647.329239:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375680 00000100:00100000:3.0:1788970647.329260:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102375936 00000100:00100000:3.0:1788970647.329262:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102375936 00000100:00100000:3.0:1788970647.329273:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970647.329279:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102375680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329307:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102375680:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970647.329318:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788970647.329330:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970647.329335:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102375936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329361:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102375936:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970647.329366:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788970647.329436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102375680:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102375552:0@lo:400:kworker.0 00010000:00080000:3.0:1788970647.329455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ea1f2f480 x1875871102376320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970647.329464:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102376320:0@lo:400:kworker.0 00000100:00100000:3.0:1788970647.329498:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102375936:0@lo:400:kworker.0 00010000:00080000:3.0:1788970647.329506:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d830ead00 x1875871102375808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970647.329514:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102375808:0@lo:400:kworker.0 00010000:00010000:0.0:1788970647.645131:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970648.348636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970648.348658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102376448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970648.348727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970648.348777:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376448 00000100:00100000:0.0:1788970648.348784:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376448 00000100:00100000:0.0:1788970648.348830:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970648.348840:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102376448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970648.348872:0:23454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970648.348919:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102376448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970648.348941:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970648.348990:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102376448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970648.351616:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788970648.351633:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102376576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970648.351697:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970648.351740:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376576 00000100:00100000:0.0:1788970648.351748:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376576 00000100:00100000:0.0:1788970648.351845:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970648.351853:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875871102376576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970648.351887:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970648.351930:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1875871102376576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970648.351937:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970648.351979:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102376576:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788970648.671819:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788970648.874482:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788970649.692655:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788970650.013250:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788970650.248577:0:24214:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788970650.248581:0:24214:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788970650.248582:0:24214:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788970650.248697:0:24214:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7d82193800 00000020:01000004:3.0:1788970650.248714:0:24214:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788970650.248749:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788970650.248763:0:24214:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a7e84850000) 00000020:00000080:3.0:1788970650.248780:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000040:00080000:3.0:1788970650.273300:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00100000:10000000:1.0:1788970650.314233:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788970650.316016:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788970650.316229:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788970650.316629:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788970650.317064:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788970650.317473:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788970650.317701:0:24214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788970650.320941:0:24214:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788970650.321541:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788970650.321558:0:24214:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788970650.321574:0:24214:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c704bd 00000020:01000004:2.0:1788970650.321582:0:24214:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788970650.321605:0:24214:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788970650.321609:0:24214:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788970650.321614:0:24214:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788970650.321619:0:24214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788970650.321633:0:24214:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a7ebd8ecd40) 00000020:00000080:2.0:1788970650.321647:0:24214:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788970650.322806:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788970650.322976:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788970650.322983:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788970650.328853:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788970650.328865:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788970650.333443:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788970650.333460:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788970650.336186:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970650.336370:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788970650.336377:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788970650.337468:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788970650.337479:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788970650.358583:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788970650.359803:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788970650.359812:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788970650.363282:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788970650.363298:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788970650.365443:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788970650.365462:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788970650.368033:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970650.368246:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788970650.368254:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788970650.370034:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788970650.370046:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788970650.415763:0:24214:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788970650.415966:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788970650.415973:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788970650.423147:0:24214:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788970650.423169:0:24214:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788970650.424917:0:24214:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788970650.424948:0:24214:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788970650.424954:0:24214:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788970650.437294:0:24214:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788970650.437369:0:24214:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.115@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788970650.437373:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788970650.437375:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788970650.437376:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970650.437378:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970650.437557:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970650.437559:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970650.437560:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970650.437562:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970650.437564:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970650.437567:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788970650.437569:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788970650.437577:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788970650.437578:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970650.437579:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970650.437580:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970650.437582:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970650.437583:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970650.437584:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970650.437585:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788970650.437612:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788970650.437632:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376704:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788970650.437739:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.437831:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970650.437939:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376704 00000100:00100000:3.0:1788970650.437947:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376704 00000100:00100000:3.0:1788970650.438036:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788970650.438462:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:24214:x1875871102376704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788970650.438507:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788970650.438510:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788970650.438515:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788970650.439796:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:24214:x1875871102376704:12345-0@lo:253:mount.lustre.0 Request processed in 1746us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970650.439807:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788970650.439898:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376704:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970650.439913:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788970650.439917:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970650.439918:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788970650.439920:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970650.439921:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970650.439922:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970650.439924:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970650.439925:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970650.439926:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970650.439927:0:24214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788970650.439947:0:24214:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7d82193800 from lustre-OST0000 10000000:01000000:0.0:1788970650.439974:0:24214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788970650.439977:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788970650.440013:0:24214:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83068000 local copy 00010000:00010000:0.0:1788970650.440025:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970650.440132:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970650.440165:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.440209:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970650.440330:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376832 00000100:00100000:1.0:1788970650.440336:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376832 00000100:00100000:1.0:1788970650.440415:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788970650.440426:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:24214:x1875871102376832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970650.440497:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:24214:x1875871102376832:12345-0@lo:501:mount.lustre.0 Request processed in 73us (331us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970650.440505:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788970650.440583:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376832:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788970650.440618:0:24214:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788970650.440637:0:24214:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788970650.440643:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970650.440653:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970650.440681:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7d82193800 10000000:01000000:0.0:1788970650.440686:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788970650.440691:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788970650.440694:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788970650.440698:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788970650.440701:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788970650.440723:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970650.440731:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970650.440741:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970650.440753:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970650.440779:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.440809:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970650.440849:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102376960 00000100:00100000:1.0:1788970650.440859:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102376960 00000100:00100000:1.0:1788970650.440876:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788970650.440882:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+18:24214:x1875871102376960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970650.440890:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970650.440902:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c704d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c704cb expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.440923:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c704d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c704cb expref: 19 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.440932:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a600/0xc3abfebe76c704d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704cb expref: 19 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.440939:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a600, rc 0) 00000100:00100000:1.0:1788970650.440973:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102376960:12345-0@lo:101:mount.lustre.0 Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970650.440979:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788970650.441188:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102376960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788970650.441201:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704d2 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970650.441217:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c704d2 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788970650.443335:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788970650.444120:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788970650.448921:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788970650.448985:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788970650.448999:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788970650.449011:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788970650.449022:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788970650.449037:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788970650.449053:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788970650.449065:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788970650.449076:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788970650.449089:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788970650.449101:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788970650.449113:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788970650.449141:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788970650.449146:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788970650.449251:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970650.449322:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.449605:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ca4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.449689:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377088 00000100:00100000:2.0:1788970650.449698:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377088 00000100:00100000:2.0:1788970650.449835:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788970650.449845:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970650.450000:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377088:12345-0@lo:501:mount.lustre.0 Request processed in 157us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.450020:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788970650.450093:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970650.450127:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788970650.450167:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.450615:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ca4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788970650.450796:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377216 00000100:00100000:1.0:1788970650.450804:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377216 00000100:00100000:1.0:1788970650.450837:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788970650.450845:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970650.451654:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377216:12345-0@lo:503:mount.lustre.0 Request processed in 806us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970650.451663:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788970650.451792:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788970650.452439:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788970650.452528:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970650.452580:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.452838:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8708ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.455298:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377344 00000100:00100000:2.0:1788970650.455560:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377344 00000100:00100000:2.0:1788970650.455627:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788970650.455637:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.456248:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377344:12345-0@lo:502:mount.lustre.0 Request processed in 608us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.456257:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788970650.456458:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970650.456749:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788970650.456782:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788970650.456797:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788970650.456810:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788970650.456824:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788970650.456838:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788970650.456853:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788970650.456867:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788970650.456882:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788970650.456896:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788970650.456910:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788970650.456924:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788970650.456960:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970650.457011:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.457040:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8373ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.457107:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377472 00000100:00100000:2.0:1788970650.457113:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377472 00000100:00100000:2.0:1788970650.457137:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788970650.457145:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.457233:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377472:12345-0@lo:502:mount.lustre.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.457240:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788970650.457337:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788970650.457376:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788970650.457429:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788970650.459612:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788970650.459624:0:24231:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788970650.459631:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.459633:0:24231:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788970650.459639:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788970650.459665:0:24231:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a7d81aeb380) 00000020:00000080:0.0:1788970650.459692:0:24231:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788970650.459699:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788970650.459788:0:24231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d82193800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788970650.459797:0:24231:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788970650.459804:0:24231:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3abfebe76c704e0 00010000:00010000:0.0:1788970650.463951:0:24231:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788970650.464515:0:24231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788970650.465760:0:24231:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788970650.471671:0:24231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788970650.471683:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970650.471691:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471693:0:24231:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788970650.471696:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788970650.471699:0:24231:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788970650.471704:0:24231:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970650.471705:0:24231:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788970650.471707:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788970650.471709:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471711:0:24231:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788970650.471713:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970650.471716:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471717:0:24231:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788970650.471720:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788970650.471722:0:24231:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788970650.471724:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970650.471726:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471727:0:24231:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788970650.471729:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970650.471731:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471732:0:24231:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788970650.471735:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788970650.471762:0:24231:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970650.471764:0:24231:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970650.471772:0:24231:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788970650.471775:0:24231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788970650.474428:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788970650.474484:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788970650.474506:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704d2 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474518:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83024600/0xc3abfebe76c704cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704d2 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970650.474525:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d82193800 from 1 10000000:01000000:2.0:1788970650.474527:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970650.474565:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474582:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474593:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970650.474616:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970650.474687:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.474726:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8847e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.474757:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377600 00000100:00100000:2.0:1788970650.474764:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377600 00000100:00100000:2.0:1788970650.474805:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970650.474813:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:24214:x1875871102377600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970650.474826:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970650.474838:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c704e7 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474865:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474876:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.474886:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed98e00, rc 0) 00000100:00100000:2.0:1788970650.474925:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377600:12345-0@lo:101:mount.lustre.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.474931:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788970650.474988:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970650.475003:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.475012:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970650.477145:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788970650.478186:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970650.478450:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788970650.478476:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788970650.478490:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788970650.478503:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788970650.478517:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788970650.478546:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788970650.478561:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788970650.478572:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788970650.478583:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788970650.478594:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788970650.478606:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788970650.478625:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788970650.478631:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788970650.478714:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970650.478779:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.478816:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970650.482027:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377728 00000100:00100000:1.0:1788970650.482043:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377728 00000100:00100000:1.0:1788970650.482110:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788970650.482121:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970650.482321:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377728:12345-0@lo:501:mount.lustre.0 Request processed in 201us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970650.482329:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788970650.482528:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970650.482579:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970650.482631:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970650.482657:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.482736:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377856 00000100:00100000:2.0:1788970650.482741:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377856 00000100:00100000:2.0:1788970650.482774:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788970650.482782:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970650.482859:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377856:12345-0@lo:503:mount.lustre.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.482871:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788970650.482974:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970650.483455:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970650.483546:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970650.483585:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970650.483604:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.483790:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102377984 00000100:00100000:2.0:1788970650.483795:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102377984 00000100:00100000:2.0:1788970650.483833:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788970650.483841:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.483928:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102377984:12345-0@lo:502:mount.lustre.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.483935:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788970650.484017:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102377984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970650.484208:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788970650.484232:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788970650.484245:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788970650.484256:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788970650.484268:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788970650.484280:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788970650.484291:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788970650.484318:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788970650.484332:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788970650.484344:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788970650.484356:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788970650.484428:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970650.484465:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970650.484486:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.484615:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378112 00000100:00100000:2.0:1788970650.484620:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378112 00000100:00100000:2.0:1788970650.484645:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788970650.484652:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102378112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.484731:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102378112:12345-0@lo:502:mount.lustre.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.484738:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788970650.484809:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970650.484847:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788970650.484855:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788970650.486293:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970650.486370:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.486373:0:24235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788970650.486829:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d82193800 00000020:00000080:1.0:1788970650.486833:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970650.486841:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970650.486844:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.486853:0:24235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788970650.486857:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970650.486859:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.486861:0:24235:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788970650.486864:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7d82193800 00000020:00000080:1.0:1788970650.486866:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970650.486966:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970650.486970:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.486971:0:24235:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788970650.486973:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970650.486976:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.486977:0:24235:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970650.486980:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d82193800 00000020:00000080:1.0:1788970650.486982:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970650.489441:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970650.489453:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.489455:0:24235:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970650.489460:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970650.489464:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.489466:0:24235:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788970650.489471:0:24235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7d82193800 00000020:00000080:1.0:1788970650.489473:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970650.489534:0:24235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970650.489537:0:24235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970650.489539:0:24235:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788970650.489542:0:24235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788970650.489749:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788970650.489785:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970650.489811:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.489824:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970650.489897:0:24214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788970650.489900:0:24214:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7d82193800 10000000:01000000:2.0:1788970650.489904:0:24214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7d82193800 10000000:01000000:2.0:1788970650.489909:0:24214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970650.489924:0:24214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7d82193800 from 1 10000000:01000000:2.0:1788970650.489927:0:24214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788970650.489964:0:24214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.489973:0:24214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.489984:0:24214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970650.490009:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970650.490078:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.490123:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.490148:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378240 00000100:00100000:2.0:1788970650.490155:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378240 00000100:00100000:2.0:1788970650.490193:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788970650.490201:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:24214:x1875871102378240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970650.490212:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970650.490225:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c704fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c704f5 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.490253:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c704fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c704f5 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.490264:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed99c00/0xc3abfebe76c704fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704f5 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.490272:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed99c00, rc 0) 00000100:00100000:2.0:1788970650.490320:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378240:12345-0@lo:101:mount.lustre.0 Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.490333:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788970650.490426:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970650.490442:0:24214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704fc expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.490450:0:24214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c704fc expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970650.491961:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788970650.492232:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788970650.493396:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788970650.494481:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788970650.494506:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788970650.494520:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788970650.494569:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788970650.494587:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788970650.494603:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788970650.494619:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788970650.494634:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788970650.494648:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788970650.494664:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788970650.494679:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788970650.494694:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788970650.494708:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788970650.494722:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788970650.494737:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788970650.494749:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788970650.494763:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788970650.494778:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788970650.494792:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788970650.494825:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788970650.494840:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788970650.494864:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788970650.494878:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788970650.494891:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788970650.494905:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788970650.494917:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788970650.494929:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788970650.494943:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788970650.494957:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788970650.494969:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788970650.494982:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788970650.494995:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788970650.495006:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788970650.495016:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788970650.495026:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788970650.495049:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788970650.495064:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788970650.495076:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788970650.495089:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788970650.495103:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788970650.495117:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788970650.495131:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788970650.495145:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788970650.495159:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788970650.495175:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788970650.495188:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788970650.495201:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788970650.495850:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788970650.495880:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788970650.499558:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788970650.499585:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788970650.499702:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970650.499780:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.499826:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494780 going to sleep for 11 seconds 00000100:00100000:3.0:1788970650.500003:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378368 00000100:00100000:3.0:1788970650.500012:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378368 00000100:00100000:3.0:1788970650.500068:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788970650.500078:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970650.500212:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378368:12345-0@lo:501:mount.lustre.0 Request processed in 136us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970650.500220:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788970650.502054:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970650.502107:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970650.502172:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.502209:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378496 00000100:00100000:2.0:1788970650.502215:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378496 00000100:00100000:2.0:1788970650.502254:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970650.502263:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970650.502452:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378496:12345-0@lo:503:mount.lustre.0 Request processed in 189us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.502460:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788970650.502501:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.502513:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378496:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970650.502928:0:24214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970650.503004:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.503036:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.503062:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378624 00000100:00100000:2.0:1788970650.503066:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378624 00000100:00100000:2.0:1788970650.503091:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970650.503098:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.503173:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378624:12345-0@lo:502:mount.lustre.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.503179:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788970650.503211:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.503229:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970650.506550:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788970650.506602:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788970650.506617:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788970650.506628:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788970650.506638:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788970650.506648:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788970650.506658:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788970650.506668:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788970650.506680:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788970650.506690:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788970650.506702:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788970650.506714:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788970650.506725:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788970650.506737:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788970650.506764:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788970650.506777:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788970650.506789:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788970650.506800:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788970650.506811:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788970650.506823:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788970650.506835:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788970650.506846:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788970650.506857:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788970650.506868:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788970650.506879:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788970650.506891:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788970650.506902:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788970650.506912:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788970650.506922:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788970650.506933:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788970650.506954:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788970650.506975:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788970650.506986:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788970650.506998:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788970650.507011:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788970650.507023:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788970650.507034:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788970650.507046:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788970650.507058:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788970650.507071:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788970650.507083:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788970650.507097:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788970650.507110:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788970650.507123:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788970650.507137:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788970650.507151:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788970650.507178:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788970650.507194:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788970650.507246:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.511646:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.511773:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378752 00000100:00100000:2.0:1788970650.511782:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378752 00000100:00100000:2.0:1788970650.511829:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788970650.511838:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.511976:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378752:12345-0@lo:502:mount.lustre.0 Request processed in 140us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.511985:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788970650.512036:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.512058:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970650.512241:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788970650.512274:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788970650.513941:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970650.514016:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.514058:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb1494cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970650.515461:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102378880 00000100:00100000:0.0:1788970650.515475:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102378880 00000100:00100000:0.0:1788970650.515541:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788970650.515552:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970650.515740:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102378880:12345-0@lo:502:mount.lustre.0 Request processed in 189us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970650.515749:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788970650.516467:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102378880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970650.516558:0:24214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788970650.516576:0:24214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788970650.517930:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788970650.517948:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a7d81ae8000) 00000020:00000080:0.0:1788970650.517971:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788970650.518065:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d82193800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788970650.518070:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d82193800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788970650.518079:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d82193800 3 00010000:00080000:0.0:1788970650.518109:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7e982a1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:0.0:1788970650.520905:0:24240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788970650.521103:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788970650.521149:0:24240:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788970650.521165:0:24240:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3abfebe76c7050a 00000100:00080000:0.0:1788970650.521176:0:24240:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788970650.521188:0:24240:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a7e982a1800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970650.521227:0:24240:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d835683c0 x1875871102379008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970650.521280:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102379008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788970650.521431:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970650.521498:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379008 00000100:00100000:0.0:1788970650.521504:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379008 00000100:00100000:0.0:1788970650.521543:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970650.521550:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102379008:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788970650.521575:0:22712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:0.0:1788970650.521614:0:22712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3abfebe76c70511 00000004:00100000:0.0:1788970650.521629:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970650.521661:0:22712:0:(import.c:65:import_set_state_nolock()) ffff8a7d831e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970650.521711:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875871102379008:12345-0@lo:38:llog_process_th.0 Request processed in 159us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970650.521719:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788970650.521758:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7d835683c0 x1875871102379008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970650.521768:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970650.521776:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788970650.521782:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788970650.521786:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788970650.521788:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e982a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970650.521794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3648:1875871102379008:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788970650.521811:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788970650.524998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.525005:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.525008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.525010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.525045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.525049:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.525051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.525055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970650.525101:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102379136:0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525213:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.525251:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970650.525257:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102379520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525283:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.525428:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102379264:0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525454:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.525474:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970650.525492:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102379392:0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.525578:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379136 00000100:00100000:2.0:1788970650.525585:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379136 00000100:00100000:2.0:1788970650.525622:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379392 00000100:00100000:2.0:1788970650.525625:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379392 00000100:00100000:2.0:1788970650.525640:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970650.525648:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102379136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525700:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102379136:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.525707:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970650.525724:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970650.525730:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102379392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525756:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102379392:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.525762:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970650.525780:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379520 00000100:00100000:2.0:1788970650.525783:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379520 00000100:00100000:2.0:1788970650.525803:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379264 00000100:00100000:2.0:1788970650.525806:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379264 00000100:00100000:2.0:1788970650.525818:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970650.525823:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102379520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525865:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102379520:12345-0@lo:400:kworker.0 Request processed in 41us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.525871:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970650.525883:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970650.525889:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102379264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.525921:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102379264:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.525927:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970650.525976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102379392:0@lo:400:kworker.0 00010000:00080000:2.0:1788970650.525988:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebcf603c0 x1875871102379264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970650.525998:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102379264:0@lo:400:kworker.0 00010000:00080000:2.0:1788970650.526023:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebcf61a40 x1875871102379520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970650.526032:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102379520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970650.526039:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102379136:0@lo:400:kworker.0 00000020:01000004:2.0:1788970650.526242:0:24240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788970650.526258:0:24240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a7eb3dc4d40) 00000020:00000080:2.0:1788970650.526280:0:24240:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788970650.527502:0:24240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7d82193800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970650.527511:0:24240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7d82193800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788970650.527514:0:24240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7d82193800 3 00010000:00080000:2.0:1788970650.527542:0:24240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7e982a3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.115@tcp at head 00010000:00010000:2.0:1788970650.534196:0:24240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788970650.536126:0:24240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788970650.536171:0:24240:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788970650.536181:0:24240:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc3abfebe76c7051f 00000100:00080000:2.0:1788970650.536192:0:24240:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788970650.536202:0:24240:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a7e982a3000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970650.536236:0:24240:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ebcf62d00 x1875871102379648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788970650.536278:0:24240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788970650.536313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.536317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.536320:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.536323:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.536328:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.536330:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788970650.536333:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788970650.536336:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788970650.536932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102379648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788970650.536994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.537085:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379648 00000100:00100000:2.0:1788970650.537093:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379648 00000100:00100000:2.0:1788970650.537132:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788970650.537139:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102379648:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788970650.537163:0:22711:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:2.0:1788970650.537201:0:22711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc3abfebe76c70526 00000004:00100000:2.0:1788970650.537216:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970650.537242:0:22711:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf422800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970650.537296:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875871102379648:12345-0@lo:38:llog_process_th.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.537316:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788970650.537351:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a7ebcf62d00 x1875871102379648/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970650.537371:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788970650.537399:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788970650.537418:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788970650.537422:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788970650.537425:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7e982a3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788970650.537431:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3648:1875871102379648:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788970650.540546:0:24240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788970650.540605:0:24214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788970650.540638:0:24214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788970650.540659:0:24214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704fc expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.540671:0:24214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99000/0xc3abfebe76c704f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c704fc expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788970650.540788:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788970650.540790:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970650.540796:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970650.540798:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970650.540799:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970650.540800:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970650.540801:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970650.540803:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970650.540805:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970650.540808:0:24214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788970650.540810:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970650.540812:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970650.540813:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970650.540814:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970650.540815:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970650.540815:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970650.540825:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970650.540826:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970650.540826:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788970650.540850:0:24214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788970650.540869:0:24214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102379776:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970650.540932:0:24214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.540977:0:24214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0ebccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788970650.540999:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379776 00000100:00100000:2.0:1788970650.541006:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379776 00000100:00100000:2.0:1788970650.541053:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970650.541060:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102379776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970650.541083:0:22703:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788970650.541095:0:22703:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788970650.544470:0:22703:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788970650.544488:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788970650.544767:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:24214:x1875871102379776:12345-0@lo:253:mount.lustre.0 Request processed in 3702us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.544780:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788970650.544845:0:24214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:24214:1875871102379776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970650.544858:0:24214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788970650.544861:0:24214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970650.544863:0:24214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788970650.544864:0:24214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970650.544866:0:24214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970650.544867:0:24214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970650.544868:0:24214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970650.544869:0:24214:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970650.544871:0:24214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970650.544872:0:24214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788970650.544886:0:24214:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788970650.545563:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788970650.545568:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788970650.545586:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545603:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545621:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545629:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545660:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545674:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 20 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970650.545687:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102379904:0@lo:104: 00000100:00100000:1.0:1788970650.545723:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970650.545771:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545780:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970650.545788:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102380032:0@lo:104: 00000100:00100000:1.0:1788970650.545808:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970650.545822:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970650.545841:0:22694:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788970650.545852:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102379904 00000100:00100000:1.0:1788970650.545857:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102379904 00000100:00100000:1.0:1788970650.545881:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380032 00000100:00100000:1.0:1788970650.545883:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380032 00000100:00100000:1.0:1788970650.545895:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970650.545908:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102379904:12345-0@lo:104: 00010000:00010000:1.0:1788970650.545919:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.545960:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970650.545965:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102379904:12345-0@lo:104: Request processed in 58us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970650.545971:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788970650.545984:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970650.545989:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaff80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102380032:12345-0@lo:104: 00010000:00010000:1.0:1788970650.545996:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546021:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788970650.546026:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaff80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102380032:12345-0@lo:104: Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970650.546031:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970650.546071:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102379904:0@lo:104: 00000100:00100000:1.0:1788970650.546078:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102380032:0@lo:104: 00010000:00010000:1.0:1788970650.546093:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546114:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970650.546120:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546127:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970650.546136:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546145:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970650.546153:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970650.546159:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970650.546181:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546187:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970650.546202:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546209:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9ac00/0xc3abfebe76c7047e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70485 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546220:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970650.546223:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546228:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970650.546231:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546237:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970650.546255:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970650.546260:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788970650.546275:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546281:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970650.546293:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546299:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83025600/0xc3abfebe76c70470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70477 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970650.546414:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970650.546417:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970650.546418:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970650.546425:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970650.546578:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102380160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970650.546612:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.546669:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102380288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970650.546694:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970650.546743:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380160 00000100:00100000:2.0:1788970650.546748:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380160 00010000:00010000:2.0:1788970650.546768:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 21 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970650.546789:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380288 00000100:00100000:2.0:1788970650.546792:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380288 00010000:00010000:2.0:1788970650.546803:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 22 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970650.546819:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970650.546825:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:3652:x1875871102380160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970650.546835:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970650.546840:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 22 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546849:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 22 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546862:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9aa00/0xc3abfebe76c70485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c7047e expref: 22 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546872:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970650.546900:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:3652:x1875871102380160:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.546906:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970650.546919:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970650.546924:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaecb0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:3649:x1875871102380288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788970650.546937:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970650.546941:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546950:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546959:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9a200/0xc3abfebe76c70477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70470 expref: 20 pid: 22704 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546969:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546977:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788970650.546988:0:22696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005391432s 00010000:00010000:2.0:1788970650.546992:0:22696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.546999:0:22696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547006:0:22696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547012:0:22696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547018:0:22696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9bc00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970650.547022:0:22696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547036:0:22696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547050:0:22696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547067:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970650.547093:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaecb0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:3649:x1875871102380288:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970650.547099:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788970650.547144:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547152:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970650.547158:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9bc00/0xc3abfebe76c7052d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970650.547184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102380288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970650.547204:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102380160:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788970650.549992:0:24214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788970650.562504:0:24214:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788970650.562514:0:24214:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788970650.562551:0:24214:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788970650.562593:0:24214:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788970650.562621:0:24214:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788970650.562643:0:24214:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788970650.563462:0:24214:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970650.563672:0:24214:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788970650.718245:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788970651.332823:0:24294:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788970651.333044:0:24294:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970651.741777:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788970651.806559:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788970651.806567:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d81a76800 from 13 10000000:01000000:1.0:1788970651.806573:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788970651.806619:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970651.806631:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970651.806643:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970651.806683:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788970651.806757:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970651.806809:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788970651.806877:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380416 00000100:00100000:3.0:1788970651.806885:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380416 00000100:00100000:3.0:1788970651.806941:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788970651.806950:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+19:22708:x1875871102380416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970651.806962:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970651.806973:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70534 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970651.806994:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970651.807004:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 20 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970651.807023:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7ec21f5200, rc 0) 00000100:00100000:3.0:1788970651.807065:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:22708:x1875871102380416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970651.807071:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788970651.807155:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788970651.807170:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970651.807179:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970651.807227:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788970651.807257:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970651.807278:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970651.807329:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380544 00000100:00100000:0.0:1788970651.807333:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380544 00000100:00100000:0.0:1788970651.807363:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970651.807370:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:22708:x1875871102380544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970651.807413:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970651.807439:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970651.807442:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788970651.807520:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:22708:x1875871102380544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970651.807533:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788970651.807565:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970651.807629:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970651.807636:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807644:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970651.807653:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788970651.807655:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d827a9000 from 13 10000000:01000000:0.0:1788970651.807657:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788970651.807675:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807682:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807690:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970651.807703:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970651.807727:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970651.807742:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970651.807753:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380672 00000100:00100000:0.0:1788970651.807757:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380672 00000100:00100000:0.0:1788970651.807774:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970651.807779:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:22708:x1875871102380672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970651.807791:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970651.807799:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70542 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807813:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807821:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807827:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83025000, rc 0) 00000100:00100000:0.0:1788970651.807854:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102380672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970651.807860:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788970651.807887:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970651.807898:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.807905:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970651.807938:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788970651.807963:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970651.807977:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970651.807988:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380800 00000100:00100000:0.0:1788970651.807991:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380800 00000100:00100000:0.0:1788970651.808009:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970651.808013:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102380800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970651.808029:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970651.808038:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970651.808041:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788970651.808099:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102380800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970651.808105:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788970651.808130:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102380800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970651.808161:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970651.808166:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970651.808174:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970652.573874:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970637/real 1788970637] req@ffff8a7d830ea1c0 x1875871102367488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970652.573907:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d830ea1c0 x1875871102367488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970652.573917:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970637/real 1788970637] req@ffff8a7d830ebc00 x1875871102367360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970652.573929:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d830ebc00 x1875871102367360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788970652.573948:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970652.573965:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788970652.573978:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367488:0@lo:8:kworker.0 00000100:00080000:1.0:1788970652.573985:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83708000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970652.574065:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:0.0:1788970652.574552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970652.574557:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788970652.574559:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7d83708000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970652.574565:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 656 00000100:00100000:2.0:1788970652.574567:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102380928:0@lo:400:kworker.0 00000100:00080000:0.0:1788970652.574570:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970652.574579:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a7d83708000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970652.574598:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8356a1c0 x1875871102381056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970652.574607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970652.574610:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970652.574611:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970652.574614:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 656 00000100:00080000:0.0:1788970652.574621:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970652.574626:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:2.0:1788970652.574627:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970652.574637:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83569e00 x1875871102381184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970652.574666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970652.574670:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970652.574672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788970652.574674:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102380928 00000100:00080000:0.0:1788970652.574675:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788970652.574681:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102380928 00000100:00100000:0.0:1788970652.574706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102381568:0@lo:400:kworker.0 00000100:00100000:2.0:1788970652.574718:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970652.574734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970652.574740:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.574756:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970652.574761:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102381696:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.574780:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970652.574785:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102380928:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970652.574792:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970652.574800:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102381312:0@lo:400:kworker.0 00000100:00100000:2.0:1788970652.574811:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102381440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.574819:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970652.574831:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970652.574835:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102381824:0@lo:400:kworker.0 00000100:00100000:2.0:1788970652.574856:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381440 00000100:00100000:0.0:1788970652.574858:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970652.574860:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381440 00000100:00100000:0.0:1788970652.574877:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381568 00000100:00100000:2.0:1788970652.574879:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970652.574880:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381568 00000100:00100000:2.0:1788970652.574884:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970652.574917:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102381440:12345-0@lo:400:kworker.0 Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970652.574923:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788970652.574958:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102381440:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575000:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381696 00000100:00100000:0.0:1788970652.575005:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381696 00000100:00100000:0.0:1788970652.575104:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381312 00000100:00100000:0.0:1788970652.575108:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381312 00000100:00100000:0.0:1788970652.575119:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381824 00000100:00100000:0.0:1788970652.575122:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381824 00000100:00100000:0.0:1788970652.575137:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788970652.575143:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970652.575146:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970652.575327:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575372:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102381568:12345-0@lo:400:kworker.0 Request processed in 223us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970652.575410:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970652.575426:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788970652.575429:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8356bc00 x1875871102381568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970652.575433:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970652.575440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102381568:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575459:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102381696:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970652.575465:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788970652.575468:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83568b40 x1875871102381696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970652.575475:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970652.575476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102381696:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575480:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102381312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575512:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102381312:12345-0@lo:400:kworker.0 Request processed in 31us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970652.575518:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788970652.575519:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8356a580 x1875871102381312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970652.575527:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102381312:0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575528:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970652.575534:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102381824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970652.575571:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875871102381824:12345-0@lo:400:kworker.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970652.575577:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970652.575606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102380928:0@lo:400:kworker.0 00010000:00080000:2.0:1788970652.575685:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d835692c0 x1875871102381824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970652.575694:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3651:1875871102381824:0@lo:400:kworker.0 00000100:00100000:1.0:1788970652.576117:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102367360:0@lo:8:kworker.0 00000100:00100000:1.0:1788970652.576146:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102381056:0@lo:8:kworker.0 00000100:00100000:1.0:1788970652.576185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970652.576364:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102381184:0@lo:8:kworker.0 00000100:00100000:1.0:1788970652.576416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970652.577575:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381056 00000100:00100000:3.0:1788970652.577586:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381056 00000100:00100000:2.0:1788970652.577590:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381184 00000100:00100000:2.0:1788970652.577594:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381184 00000100:00100000:3.0:1788970652.577627:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970652.577634:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102381056:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788970652.577663:0:24220:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:3.0:1788970652.577700:0:24220:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c70550 00002000:00100000:3.0:1788970652.577713:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a7e92fc0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788970652.577717:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788970652.577720:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788970652.577960:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788970652.577984:0:24220:0:(import.c:65:import_set_state_nolock()) ffff8a7e92fc0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970652.578126:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102381056:12345-0@lo:8:kworker.0 Request processed in 491us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970652.578133:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970652.578151:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970652.578156:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102381184:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788970652.578169:0:24220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788970652.578470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8356a1c0 x1875871102381056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970652.578482:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970652.578555:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788970652.578565:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970652.578570:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788970652.578573:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83708000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970652.578587:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970652.578592:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102381056:0@lo:8:kworker.0 00000004:00080000:0.0:1788970652.578667:0:22736:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788970652.578689:0:22736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1875871102382080:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788970652.578702:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102381952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970652.578727:0:22736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970652.578736:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970652.578747:0:22736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970652.578778:0:24219:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788970652.578784:0:24219:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1788970652.579784:0:22735:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788970652.579811:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382080 00000100:00100000:1.0:1788970652.579820:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382080 00000004:00080000:0.0:1788970652.579861:0:22735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671846478963ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788970652.579868:0:22735:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1788970652.579870:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970652.580229:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970652.580240:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22736:x1875871102382080:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788970652.581219:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788970652.581750:0:24366:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788970652.581759:0:24366:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788970652.581765:0:24366:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00100000:2.0:1788970652.586643:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102381952 00000100:00100000:2.0:1788970652.586660:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102381952 00000100:00100000:2.0:1788970652.586721:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788970652.587367:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102381952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970652.587438:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970652.587645:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875871102381952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (8907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970652.587652:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788970652.588328:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83569a40 x1875871102381952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970652.588352:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102381952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970652.609055:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102381184:12345-0@lo:8:kworker.0 Request processed in 30891us (32633us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970652.609068:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788970652.609268:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788970652.609275:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788970652.609286:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102381184:0@lo:8:kworker.0 00002000:00010000:0.0:1788970652.623824:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.623838:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.623855:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.623859:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.623865:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.623883:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.623893:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.623902:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.623971:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970652.624290:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970652.624298:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.624307:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970652.624311:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.624321:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.624342:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.624350:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b1172af/0xc3abfebe76c70557 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.624368:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.624370:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.624498:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.624508:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.624517:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.624520:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.624525:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.624534:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.624542:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.624549:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.624567:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.624765:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.624772:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.624792:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.624796:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.624805:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.624819:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.624826:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fad9073/0xc3abfebe76c7055e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.624840:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.624842:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.624844:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.624896:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.625000:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.625006:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625013:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.625022:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.625026:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625035:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625043:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625050:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625070:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.625221:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.625226:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.625234:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.625237:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.625245:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.625263:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.625271:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8aefd0e/0xc3abfebe76c70565 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.625284:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.625286:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.625288:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.625617:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.625624:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625633:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.625636:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.625640:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625648:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625657:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625670:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.625688:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970652.626290:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970652.626296:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.626305:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970652.626309:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.626328:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.626342:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.626350:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085366c19/0xc3abfebe76c7056c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.626367:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.626368:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.626370:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.626799:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.626807:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.626817:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.626821:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.626825:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.626835:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.626844:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.626850:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.626870:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.627098:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.627104:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.627112:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.627116:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.627123:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.627135:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.627142:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ab9b694/0xc3abfebe76c70573 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.627180:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.627181:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.627183:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.627760:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.627775:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.627792:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.627796:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.627800:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.627810:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.627819:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.627826:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.627884:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970652.628035:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970652.628041:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.628049:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970652.628053:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.628062:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.628076:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.628092:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134a47df/0xc3abfebe76c7057a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.628107:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.628109:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.628110:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.628816:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.628824:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.628834:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.628838:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.628843:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.628853:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.628870:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.628878:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.628931:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.629138:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.629145:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.629220:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83024800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.629224:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.629233:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.629247:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.629254:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013998c95/0xc3abfebe76c70581 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.629281:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.629283:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.629285:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.629364:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.629370:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629411:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.629415:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.629419:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629429:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629437:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629443:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629477:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.629562:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.629568:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.629576:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.629579:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.629588:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.629602:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.629609:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034400f99/0xc3abfebe76c70588 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.629623:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.629625:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.629627:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.629814:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.629820:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629828:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.629831:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.629835:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629844:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629852:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629860:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.629871:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.630083:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.630089:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.630107:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.630110:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.630118:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.630129:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.630136:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087aed6b4/0xc3abfebe76c7058f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.630200:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.630203:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.630204:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.630852:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.630860:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.630871:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.630879:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.630884:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.630894:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.630902:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.630909:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.630931:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788970652.631410:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.631416:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.631425:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.631429:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.631433:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.631442:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.631449:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.631462:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.631478:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788970652.631631:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970652.631638:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631647:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.631651:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631666:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631680:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631687:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ade892f/0xc3abfebe76c70596 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631703:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.631706:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631713:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.631716:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631794:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631806:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631814:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50a7143/0xc3abfebe76c7059d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.631838:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.631839:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.631841:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.631897:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970652.632250:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970652.632257:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.632267:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=671s v=(0 0) 00010000:00010000:0.0:1788970652.632271:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970652.632275:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.632285:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.632302:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.632309:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.632327:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.632670:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.632676:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.632684:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.632688:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.632696:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.632709:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.632715:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c705a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.632807:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.632809:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.632811:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970652.633054:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.633059:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633078:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.633081:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.633086:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633096:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633103:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633111:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633219:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.633351:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.633356:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.633364:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.633369:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.633600:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.633614:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970652.633772:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.633778:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633786:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.633790:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.633794:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633804:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633824:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633831:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.633845:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.633853:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788970652.634191:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.634197:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.634205:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.634208:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.634212:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.634221:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.634229:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.634236:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.634255:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.634258:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2eee52/0xc3abfebe76c705ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634276:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.634280:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634286:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.634290:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634299:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634311:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634318:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccb9e16e/0xc3abfebe76c705b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.634341:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.634343:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.634345:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.634675:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.634678:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.634680:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.634698:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.634707:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970652.634710:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.634718:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.634729:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.634736:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d72d4515/0xc3abfebe76c705b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.634749:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.634750:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.634752:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970652.635542:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.635552:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.635564:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.635569:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.635573:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.635584:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.635593:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.635601:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.635622:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.635700:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.635706:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.635714:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.635718:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.635726:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.635739:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.635746:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaf7763a/0xc3abfebe76c705c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.635760:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.635761:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.635763:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970652.636433:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.636442:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.636464:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.636468:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.636473:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.636799:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.636813:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.636821:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.636846:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.637005:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.637012:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.637032:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.637036:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.637045:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.637058:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.637065:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a239a8e3/0xc3abfebe76c705c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.637082:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.637083:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.637085:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970652.637668:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970652.637676:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.637687:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=671s v=(0 0) 00010000:00010000:2.0:1788970652.637691:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970652.637695:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.637705:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.638266:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.638276:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.638307:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970652.638430:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970652.638442:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.638450:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970652.638454:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.638463:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.638477:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.638484:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de90ff3e/0xc3abfebe76c705ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.638502:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.638504:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970652.638505:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.642669:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.642687:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.642706:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.642711:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.642717:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.642745:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.642755:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.642762:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.642785:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.642806:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.642813:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.642821:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.642825:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.642834:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.642858:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.642865:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cd0033f/0xc3abfebe76c705d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.642881:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.642884:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.642885:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.643314:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.643321:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643330:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.643334:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.643338:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643347:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643355:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643372:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643418:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.643487:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.643492:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643501:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.643504:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643513:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643524:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643531:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340be2/0xc3abfebe76c705dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643556:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.643557:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.643559:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.643769:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.643775:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643784:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.643787:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.643791:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643800:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643807:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643814:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.643833:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.643857:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.643863:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643870:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.643874:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643881:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643892:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643900:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004de9b24/0xc3abfebe76c705e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.643912:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.643914:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.643916:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.644106:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.644112:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644126:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.644129:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.644133:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644141:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644149:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644156:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644175:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970652.644213:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.644218:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.644235:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.644239:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.644247:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.644259:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.644266:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f233d494/0xc3abfebe76c705ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.644279:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.644281:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.644283:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.644493:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.644498:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644507:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.644510:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.644514:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644523:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644541:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644548:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644569:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970652.644913:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.644919:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644928:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.644931:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.644935:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644945:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644953:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644961:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.644984:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788970652.645238:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.645245:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.645254:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.645257:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.645261:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.645270:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.645279:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645284:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788970652.645475:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.645490:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970652.645555:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645565:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.645570:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645580:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645602:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645610:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008584a73c/0xc3abfebe76c705f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645626:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970652.645630:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645637:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.645641:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645649:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645659:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645667:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c99b410/0xc3abfebe76c705f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645686:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970652.645689:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645703:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970652.645706:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645714:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645724:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645731:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1240f39/0xc3abfebe76c705ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970652.645743:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.645746:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.645748:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.645755:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.646780:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.646789:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.646800:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.646809:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.646815:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.646826:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.646835:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.646842:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.646868:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.647453:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.647461:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647470:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.647474:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647484:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647499:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647506:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df79cb65/0xc3abfebe76c70606 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647522:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.647531:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.647532:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.647785:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.647791:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.647800:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.647803:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.647807:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.647816:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.647825:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.647839:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.647866:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.647889:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.647894:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647902:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.647906:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647913:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647924:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647931:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bdc1bbb/0xc3abfebe76c7060d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.647945:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.647947:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.647948:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970652.648035:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.649029:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.649038:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.649049:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.649052:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.649057:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.649068:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.649075:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.649082:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.649102:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.649157:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.649163:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.649171:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.649175:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.649189:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.649201:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.649208:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bae511/0xc3abfebe76c70614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.649223:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.649225:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.649226:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.650098:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.650106:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650123:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.650126:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.650131:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650142:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650150:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650157:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650176:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.650217:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.650223:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650231:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.650235:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650244:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650256:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650273:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf4c312a/0xc3abfebe76c7061b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650288:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.650290:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.650291:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.650637:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.650643:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650652:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.650656:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.650660:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650670:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650687:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650694:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.650715:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.650811:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.650817:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650824:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.650828:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650836:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650847:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650855:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70622 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.650869:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.650870:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.650872:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.651061:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.651067:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651075:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.651078:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.651082:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651091:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651099:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651106:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651139:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970652.651230:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970652.651236:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.651245:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970652.651248:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.651256:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.651267:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.651274:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7748fb/0xc3abfebe76c70629 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970652.651287:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.651289:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970652.651290:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970652.651458:0:24366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970652.651464:0:24366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651472:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=671s v=(0 0) 00010000:00010000:3.0:1788970652.651475:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970652.651479:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651488:0:24366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651496:0:24366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651504:0:24366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970652.651524:0:24366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788970652.651832:0:24366:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1788970652.651911:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22736:x1875871102382080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71671us (73179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970652.651920:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970652.652849:0:22736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1875871102382080:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788970652.652869:0:22736:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788970652.652924:0:22736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1875871102382208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788970652.652965:0:22736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970652.652992:0:22736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86363240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970652.653011:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382208 00000100:00100000:0.0:1788970652.653017:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382208 00000100:00100000:0.0:1788970652.653060:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788970652.653069:0:24219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22736:x1875871102382208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788970652.653102:0:24219:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1788970652.658002:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970652.658014:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.658028:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970652.658034:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.658046:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.658066:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.658073:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b05b4909/0xc3abfebe76c70630 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970652.658094:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970652.658101:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970652.658103:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788970652.663007:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788970652.663058:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788970652.663243:0:24219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22736:x1875871102382208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10170us (10272us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788970652.663254:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970652.663433:0:22736:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788970652.663441:0:22736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1875871102382208:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788970652.663457:0:22736:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1788970652.764561:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970653.468920:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970653.468944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102382336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970653.469027:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970653.469078:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102382464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970653.469103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970653.469238:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382336 00000100:00100000:2.0:1788970653.469247:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382336 00000100:00100000:2.0:1788970653.469283:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382464 00000100:00100000:2.0:1788970653.469287:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382464 00000100:00100000:2.0:1788970653.469305:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788970653.469313:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102382336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788970653.469352:0:23454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788970653.469456:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102382336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970653.469523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102382336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970653.471531:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788970653.471567:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102382464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970653.471635:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788970653.471800:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102382464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 242us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970653.471822:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788970653.472134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102382464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970653.474508:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788970653.790936:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970654.812914:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970655.836497:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970656.136806:0:24585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788970656.867644:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788970657.051279:0:24638:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788970657.051649:0:24638:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788970657.859166:0:24689:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970657.859722:0:24689:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788970657.885737:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788970658.076611:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970658.076617:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970658.076621:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970658.076628:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788970658.076634:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788970658.076645:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970658.076671:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8356b480 x1875871102382976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970658.076703:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970658.076706:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788970658.076708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970658.076711:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788970658.076766:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.076836:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.076894:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.076954:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.076980:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788970658.076986:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102382848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.077011:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.077034:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102383488:0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.077064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.077089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102382976:0@lo:8:kworker.0 00000100:00100000:0.0:1788970658.077109:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.077142:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383104 00000100:00100000:0.0:1788970658.077149:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383104 00000100:00100000:0.0:1788970658.077184:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383616 00000100:00100000:0.0:1788970658.077187:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383616 00000100:00100000:0.0:1788970658.077208:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383488 00000100:00100000:0.0:1788970658.077210:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383488 00000100:00100000:0.0:1788970658.077226:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970658.077234:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102383104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.077277:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102383104:12345-0@lo:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970658.077283:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970658.077297:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970658.077303:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.077327:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102383616:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970658.077333:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970658.077343:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970658.077349:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970658.077426:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102383488:12345-0@lo:400:kworker.0 Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970658.077432:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788970658.077454:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970658.077458:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788970658.077488:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83568000 x1875871102383488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970658.077501:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102383488:0@lo:400:kworker.0 00010000:00080000:0.0:1788970658.077513:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d835692c0 x1875871102383104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970658.077521:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d835692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102383104:0@lo:400:kworker.0 00010000:00080000:0.0:1788970658.077530:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ebba8d2c0 x1875871102383616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970658.077538:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102383616:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.077738:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102382720:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.077773:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970658.077811:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102383360:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.077833:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970658.077855:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788970658.077861:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102382592:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.077888:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970658.077912:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102383232:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.077934:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970658.077959:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382592 00000100:00100000:1.0:1788970658.077963:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382592 00000100:00100000:1.0:1788970658.077991:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788970658.077997:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:3652:x1875871102382592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078029:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:3652:x1875871102382592:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970658.078034:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788970658.078060:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382720 00000100:00100000:1.0:1788970658.078063:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382720 00000100:00100000:1.0:1788970658.078083:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383232 00000100:00100000:1.0:1788970658.078094:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383232 00000100:00100000:1.0:1788970658.078110:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970658.078115:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102382720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078145:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102382720:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970658.078150:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788970658.078169:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970658.078174:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102383232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078198:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102383232:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970658.078203:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970658.078230:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102382592:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078238:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83569a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102383232:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078245:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102382720:0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078262:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383360 00000100:00100000:1.0:1788970658.078266:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383360 00000100:00100000:1.0:1788970658.078289:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970658.078294:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102383360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970658.078325:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102383360:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970658.078331:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788970658.078367:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8356a1c0 x1875871102383360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970658.078376:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102383360:0@lo:400:kworker.0 00000100:00100000:3.0:1788970658.079439:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382848 00000100:00100000:3.0:1788970658.079448:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382848 00000100:00100000:3.0:1788970658.079499:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102382976 00000100:00100000:3.0:1788970658.079503:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102382976 00000100:00100000:3.0:1788970658.079519:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970658.079527:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102382848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970658.079598:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102382848:12345-0@lo:400:kworker.0 Request processed in 72us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970658.079605:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788970658.079620:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970658.079624:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102382976:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788970658.079643:0:24220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788970658.079676:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102382976:12345-0@lo:8:kworker.0 Request processed in 50us (2565us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788970658.079681:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788970658.079856:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970658.079862:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788970658.079866:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102382976:0@lo:8:kworker.0 00000100:00100000:3.0:1788970658.080586:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102382848:0@lo:400:kworker.0 00000100:00080000:1.0:1788970658.081306:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970658.084731:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102383744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970658.084801:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970658.084909:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383744 00000100:00100000:3.0:1788970658.084928:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383744 00000100:00100000:3.0:1788970658.084997:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788970658.085008:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102383744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788970658.085037:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788970658.087926:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102383744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2908us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970658.087951:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788970658.093095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102383744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970658.589202:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788970658.589225:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102383872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970658.589288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970658.589452:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102383872 00000100:00100000:1.0:1788970658.589460:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102383872 00000100:00100000:1.0:1788970658.589510:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970658.589518:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102383872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970658.589548:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970658.589590:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102383872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970658.589597:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970658.589633:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102383872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970658.590031:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102384000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970658.590059:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970658.590113:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384000 00000100:00100000:0.0:1788970658.590118:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384000 00000100:00100000:0.0:1788970658.590148:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788970658.590155:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102384000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970658.590172:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970658.596522:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102384000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6358us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970658.596538:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788970658.597424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102384000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788970658.908496:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970659.933529:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970660.253111:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788970660.509180:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788970660.958506:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970661.980536:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970662.174470:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970647/real 1788970647] req@ffff8a7d830e8b40 x1875871102376064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970662.174500:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d830e8b40 x1875871102376064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970662.174509:0:3648:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788970647/real 1788970647] req@ffff8a7d830ea580 x1875871102376192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970662.174518:0:3648:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a7d830ea580 x1875871102376192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788970662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788970662.174538:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d81aca800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970662.174564:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970662.174569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102376064:0@lo:8:kworker.0 00000100:00080000:3.0:1788970662.174584:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788970662.174590:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788970662.174593:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102376192:0@lo:8:kworker.0 00000100:00100000:3.0:1788970662.174877:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3650:1875871102384128:0@lo:400:kworker.0 00000100:00100000:3.0:1788970662.174945:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788970662.175048:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970662.175057:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970662.175060:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970662.175065:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 677 00000100:00080000:0.0:1788970662.175070:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788970662.175080:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970662.175099:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d84519a40 x1875871102384512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970662.175768:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102384256:0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.175809:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970662.175836:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970662.175843:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102384384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.175865:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970662.175894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d845192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102384640:0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.175920:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970662.175954:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384256 00000100:00100000:1.0:1788970662.175962:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384256 00000100:00100000:1.0:1788970662.176009:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970662.176017:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102384256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.176069:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102384256:12345-0@lo:400:kworker.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970662.176075:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970662.176112:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384384 00000100:00100000:1.0:1788970662.176116:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384384 00000100:00100000:1.0:1788970662.176149:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970662.176156:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102384384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.176190:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102384384:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970662.176196:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788970662.176217:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384640 00000100:00100000:1.0:1788970662.176221:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384640 00000100:00100000:1.0:1788970662.176245:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970662.176251:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102384640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.176283:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102384640:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970662.176290:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970662.176515:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102384384:0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.176528:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102384256:0@lo:400:kworker.0 00000100:00080000:1.0:1788970662.176549:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788970662.176570:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d845192c0 x1875871102384640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970662.176581:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d845192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102384640:0@lo:400:kworker.0 00000100:00100000:3.0:1788970662.180962:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384128 00000100:00100000:3.0:1788970662.180978:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384128 00000100:00100000:3.0:1788970662.181028:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970662.181037:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:3650:x1875871102384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970662.181124:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:3650:x1875871102384128:12345-0@lo:400:kworker.0 Request processed in 88us (6179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970662.181131:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788970662.181183:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3650:1875871102384128:0@lo:400:kworker.0 00000100:00100000:1.0:1788970662.182444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102384512:0@lo:8:kworker.0 00000100:00100000:1.0:1788970662.182505:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.182624:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384512 00000100:00100000:0.0:1788970662.182631:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384512 00000100:00100000:0.0:1788970662.182659:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970662.182666:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102384512:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788970662.182688:0:24221:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788970662.182731:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3648:x1875871102384512:12345-0@lo:8:kworker.0 Request processed in 64us (225us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788970662.182738:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788970662.182799:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970662.182803:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788970662.182806:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7d81aca800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970662.182810:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1788970662.182815:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970662.182823:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a7d81aca800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970662.182830:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788970662.182839:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.182866:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.182895:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384768 00000100:00100000:0.0:1788970662.182904:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384768 00000100:00100000:0.0:1788970662.182931:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970662.182937:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102384768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.182976:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102384768:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.182982:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970662.183015:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.183047:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8451b840 x1875871102384896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788970662.183058:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788970662.183061:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788970662.183063:0:38:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788970662.183066:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1788970662.183069:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788970662.183073:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebb910000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:0.0:1788970662.183083:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d8451a580 x1875871102385024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970662.183110:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102385152:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.183134:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.183159:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385152 00000100:00100000:0.0:1788970662.183163:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385152 00000100:00100000:0.0:1788970662.183185:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970662.183191:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102385152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.183220:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102385152:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.183234:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788970662.183259:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451bc00 x1875871102385152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970662.183268:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102385152:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.183289:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788970662.183295:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102385280:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.183314:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.183354:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385280 00000100:00100000:0.0:1788970662.183358:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385280 00000100:00100000:1.0:1788970662.183444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102384896:0@lo:8:kworker.0 00000100:00100000:1.0:1788970662.183474:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788970662.187550:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788970662.187649:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102385024:0@lo:8:kworker.0 00000100:00100000:1.0:1788970662.187733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788970662.187791:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970662.187796:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970662.187800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102384512:0@lo:8:kworker.0 00000100:00100000:1.0:1788970662.187839:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102384896 00000100:00100000:1.0:1788970662.187845:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102384896 00000100:00100000:1.0:1788970662.187874:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385024 00000100:00100000:1.0:1788970662.187876:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385024 00000100:00100000:1.0:1788970662.187890:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970662.187896:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102384896:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788970662.187925:0:24220:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1788970662.187950:0:24220:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c70637 00002000:00100000:1.0:1788970662.187962:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a7eaed7a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788970662.187966:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788970662.187969:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788970662.188034:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788970662.188055:0:24220:0:(import.c:65:import_set_state_nolock()) ffff8a7eaed7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970662.188096:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102384896:12345-0@lo:8:kworker.0 Request processed in 199us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970662.188103:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970662.188119:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970662.188123:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102385024:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788970662.188134:0:24220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788970662.188153:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102385024:12345-0@lo:8:kworker.0 Request processed in 29us (420us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788970662.188159:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970662.188191:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970662.188198:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788970662.188205:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788970662.188209:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788970662.188212:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d81aca800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788970662.188223:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788970662.188226:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102384896:0@lo:8:kworker.0 00000100:00080000:1.0:1788970662.188234:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970662.188237:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788970662.188240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102385024:0@lo:8:kworker.0 00000004:00080000:1.0:1788970662.188288:0:23455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788970662.188303:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385536:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788970662.188548:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970662.188565:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970662.188575:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385536 00000100:00100000:1.0:1788970662.188579:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385536 00000100:00100000:1.0:1788970662.188617:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970662.188622:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1875871102385536:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788970662.189448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788970662.189463:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102385408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970662.189502:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.190873:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970662.190891:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102385280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.190973:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102385280:12345-0@lo:400:kworker.0 Request processed in 89us (7656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.190981:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788970662.191027:0:23453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788970662.191110:0:23453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 681457728245ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788970662.191116:0:23453:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1788970662.191165:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451bc00 x1875871102385280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970662.191180:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102385280:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.191367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102385664:0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.191485:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.191518:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385664 00000100:00100000:0.0:1788970662.191525:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385664 00000100:00100000:0.0:1788970662.191558:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970662.191572:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102385664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970662.191610:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102385664:12345-0@lo:400:kworker.0 Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.191616:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788970662.191643:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451bc00 x1875871102385664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970662.191653:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102385664:0@lo:400:kworker.0 00000100:00080000:0.0:1788970662.191736:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970662.191740:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970662.193045:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385408 00000100:00100000:1.0:1788970662.193056:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385408 00000100:00100000:1.0:1788970662.193098:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788970662.193107:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875871102385408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970662.193136:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970662.193201:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875871102385408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970662.193208:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970662.194836:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102385408:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788970662.199364:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788970662.200309:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788970662.200318:0:24220:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788970662.202201:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23455:x1875871102385536:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13569us (13644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.202312:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970662.202661:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385536:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788970662.202677:0:23455:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788970662.202716:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385792:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788970662.202762:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.202789:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970662.209453:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385792 00000100:00100000:2.0:1788970662.209468:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385792 00000100:00100000:2.0:1788970662.209526:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970662.209537:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1875871102385792:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788970662.209566:0:24366:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788970662.209645:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23455:x1875871102385792:12345-0@lo:5:osp-pre-0-1.0 Request processed in 109us (6881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970662.209652:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970662.209704:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385792:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788970662.209719:0:23455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788970662.209760:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf63840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385920:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788970662.209789:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970662.209808:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e883dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970662.209823:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102385920 00000100:00100000:2.0:1788970662.209832:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102385920 00000100:00100000:2.0:1788970662.209855:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788970662.209861:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23455:x1875871102385920:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788970662.209886:0:24221:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1788970662.268842:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788970662.268859:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788970662.269010:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23455:x1875871102385920:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59144us (59215us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788970662.269021:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970662.269082:0:23455:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788970662.269090:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf63840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23455:1875871102385920:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788970662.269104:0:23455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788970662.269155:0:23455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875871102386048:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788970662.269189:0:23455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970662.269534:0:23455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970662.269571:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386048 00000100:00100000:0.0:1788970662.269579:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386048 00000100:00100000:0.0:1788970662.269618:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788970662.269627:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875871102386048:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788970662.269675:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23455:x1875871102386048:12345-0@lo:900:osp-pre-0-1.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970662.269682:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788970662.269717:0:23455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d8451bc00 x1875871102386048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970678 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970662.269728:0:23455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8451bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23455:1875871102386048:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788970663.010364:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970663.197779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102386176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970663.197846:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.197979:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386176 00000100:00100000:1.0:1788970663.197988:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386176 00000100:00100000:1.0:1788970663.198047:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970663.198059:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102386176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970663.198083:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970663.198137:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102386176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.198144:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788970663.198192:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102386176:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788970663.653630:0:25033:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788970663.653634:0:25033:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788970663.653636:0:25033:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788970663.653749:0:25033:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a7ebf3b2800 00000020:01000004:2.0:1788970663.653779:0:25033:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788970663.653795:0:25033:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788970663.653809:0:25033:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a7eb3dc3380) 00000020:00000080:2.0:1788970663.653826:0:25033:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1788970663.708876:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970663.709086:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102386304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970663.709152:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970663.709409:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970663.709420:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102386432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970663.709452:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970663.709487:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386304 00000100:00100000:0.0:1788970663.709493:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386304 00000100:00100000:0.0:1788970663.709534:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386432 00000100:00100000:0.0:1788970663.709537:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386432 00000100:00100000:0.0:1788970663.709562:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970663.709580:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102386304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788970663.709613:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970663.709653:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102386304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.709660:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970663.709677:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970663.709684:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102386432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788970663.709700:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970663.709794:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102386432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.709802:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970663.709848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102386432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970663.711299:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102386304:0@lo:41:osp-pre-0-1.0 00100000:10000000:1.0:1788970663.725645:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788970663.729822:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788970663.731083:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788970663.731813:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788970663.732741:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788970663.733177:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788970663.733477:0:25033:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788970663.745479:0:25033:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788970663.746075:0:25033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788970663.746091:0:25033:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788970663.746103:0:25033:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c70645 00000020:01000004:1.0:1788970663.746111:0:25033:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788970663.746134:0:25033:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.115@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788970663.746145:0:25033:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788970663.746151:0:25033:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788970663.746184:0:25033:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788970663.746188:0:25033:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788970663.766813:0:25033:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788970663.766854:0:25033:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.115@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788970663.766860:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788970663.766862:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970663.766863:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970663.766864:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970663.766865:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970663.766867:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970663.766868:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970663.766870:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970663.766871:0:25033:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788970663.766875:0:25033:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788970663.766878:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788970663.766879:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970663.766880:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970663.766881:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970663.766882:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970663.766883:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970663.766884:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970663.766885:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970663.766886:0:25033:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788970663.768136:0:25033:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788970663.768160:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788970663.768268:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.768324:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.768419:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386560 00000100:00100000:1.0:1788970663.768427:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386560 00000100:00100000:1.0:1788970663.768491:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788970663.768500:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:25033:x1875871102386560:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788970663.768543:0:22703:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788970663.768558:0:22703:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788970663.768562:0:22703:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788970663.769885:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:25033:x1875871102386560:12345-0@lo:253:mount.lustre.0 Request processed in 1381us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.769905:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788970663.770014:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788970663.770027:0:25033:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788970663.770030:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788970663.770032:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788970663.770033:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788970663.770035:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788970663.770036:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788970663.770037:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788970663.770038:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788970663.770040:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788970663.770041:0:25033:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788970663.770061:0:25033:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a7ebf3b2800 from lustre-OST0001 10000000:01000000:2.0:1788970663.770091:0:25033:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788970663.770094:0:25033:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788970663.770111:0:25033:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a7d83068000 local copy 00010000:00010000:2.0:1788970663.770122:0:25033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970663.770246:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970663.770279:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.770318:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.770699:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386688 00000100:00100000:1.0:1788970663.770706:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386688 00000100:00100000:1.0:1788970663.770763:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788970663.770875:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:25033:x1875871102386688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970663.771069:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:25033:x1875871102386688:12345-0@lo:501:mount.lustre.0 Request processed in 297us (789us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970663.771077:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788970663.771822:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386688:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788970663.771844:0:25033:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788970663.771952:0:25033:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788970663.772103:0:25033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970663.772115:0:25033:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed99800/0xc3abfebe76c70278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7027f expref: -99 pid: 22690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970663.772161:0:25033:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a7ebf3b2800 10000000:01000000:2.0:1788970663.772166:0:25033:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788970663.772171:0:25033:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788970663.772174:0:25033:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788970663.772178:0:25033:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788970663.772181:0:25033:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788970663.772210:0:25033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970663.772218:0:25033:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970663.772228:0:25033:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970663.772252:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788970663.772401:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.772486:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.772527:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386816 00000100:00100000:1.0:1788970663.772533:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386816 00000100:00100000:1.0:1788970663.772578:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788970663.772586:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:25033:x1875871102386816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970663.772599:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970663.772611:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c70653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c7064c expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.772646:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c70653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c7064c expref: 22 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.772657:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9a800/0xc3abfebe76c70653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7064c expref: 22 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.772665:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9a800, rc 0) 00000100:00100000:1.0:1788970663.772741:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102386816:12345-0@lo:101:mount.lustre.0 Request processed in 155us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.772748:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788970663.772808:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788970663.772821:0:25033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70653 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970663.772829:0:25033:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c70653 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788970663.775117:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788970663.776244:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970663.780085:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788970663.780150:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788970663.780169:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788970663.780182:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788970663.780197:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788970663.780296:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788970663.780323:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788970663.780338:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788970663.780350:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788970663.780375:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788970663.780471:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788970663.780672:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970663.780810:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.781040:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea1ec7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.781099:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102386944 00000100:00100000:1.0:1788970663.781106:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102386944 00000100:00100000:1.0:1788970663.781191:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788970663.781202:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102386944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970663.781867:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102386944:12345-0@lo:501:mount.lustre.0 Request processed in 664us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.781876:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788970663.782148:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102386944:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970663.782205:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970663.782338:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.782620:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82163d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.782821:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387072 00000100:00100000:1.0:1788970663.782827:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387072 00000100:00100000:1.0:1788970663.782857:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788970663.782865:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970663.783939:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387072:12345-0@lo:503:mount.lustre.0 Request processed in 1071us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.783949:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788970663.784192:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387072:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788970663.784856:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788970663.785064:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970663.785125:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.785234:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d821639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970663.785727:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387200 00000100:00100000:0.0:1788970663.785831:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387200 00000100:00100000:3.0:1788970663.785926:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788970663.785938:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970663.787031:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387200:12345-0@lo:502:mount.lustre.0 Request processed in 1089us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970663.787041:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788970663.787486:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970663.788092:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788970663.788127:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788970663.788144:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788970663.788663:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788970663.788691:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788970663.788705:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788970663.788720:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788970663.788845:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788970663.788868:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788970663.789060:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970663.789136:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.789240:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e9553fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.789346:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387328 00000100:00100000:1.0:1788970663.789355:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387328 00000100:00100000:1.0:1788970663.789655:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788970663.789666:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970663.789804:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387328:12345-0@lo:502:mount.lustre.0 Request processed in 140us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.789812:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788970663.789910:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970663.789978:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788970663.789991:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788970663.790944:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788970663.790953:0:25037:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788970663.790967:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788970663.790970:0:25037:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788970663.790976:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788970663.790992:0:25037:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a7eb3dc19c0) 00000020:00000080:2.0:1788970663.791015:0:25037:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788970663.791021:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788970663.791109:0:25037:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7ebf3b2800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788970663.791117:0:25037:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788970663.791123:0:25037:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3abfebe76c70661 00010000:00010000:3.0:1788970663.796195:0:25037:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788970663.797116:0:25037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788970663.799173:0:25037:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788970663.801696:0:25037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788970663.801716:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970663.801723:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970663.801725:0:25037:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788970663.801728:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970663.801743:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970663.801744:0:25037:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788970663.801748:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788970663.801750:0:25037:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788970663.801752:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970663.801754:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970663.801755:0:25037:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788970663.801757:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788970663.801760:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970663.801761:0:25037:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788970663.801764:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788970663.801792:0:25037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788970663.801796:0:25037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788970663.801797:0:25037:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788970663.801800:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788970663.802137:0:25033:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788970663.802163:0:25033:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788970663.802187:0:25033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70653 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.802200:0:25033:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98c00/0xc3abfebe76c7064c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c70653 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970663.802215:0:25033:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebf3b2800 from 1 10000000:01000000:0.0:1788970663.802218:0:25033:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970663.802252:0:25033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.802260:0:25033:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.802280:0:25033:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.802305:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788970663.802416:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970663.802452:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8215d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788970663.802686:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387456 00000100:00100000:3.0:1788970663.802693:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387456 00000100:00100000:3.0:1788970663.802727:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788970663.802745:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:25033:x1875871102387456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970663.802757:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970663.802769:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70668 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.802791:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.802800:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.802819:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3000, rc 0) 00000100:00100000:3.0:1788970663.802862:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387456:12345-0@lo:101:mount.lustre.0 Request processed in 119us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970663.802869:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788970663.803135:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d84519a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970663.803149:0:25033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.803157:0:25033:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970663.804470:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788970663.808432:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788970663.808672:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788970663.808696:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788970663.808722:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788970663.808734:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788970663.808747:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788970663.808758:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788970663.808769:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788970663.808779:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788970663.808790:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788970663.808801:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788970663.808812:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788970663.808826:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788970663.808831:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788970663.808930:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970663.809147:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.809202:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387584 00000100:00100000:1.0:1788970663.809209:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387584 00000100:00100000:1.0:1788970663.809473:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788970663.809483:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970663.809583:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387584:12345-0@lo:501:mount.lustre.0 Request processed in 101us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.809590:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788970663.809631:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.809649:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788970663.809676:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970663.809709:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.809722:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0d12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.812798:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387712 00000100:00100000:1.0:1788970663.812814:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387712 00000100:00100000:1.0:1788970663.812875:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788970663.812885:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788970663.813471:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387712:12345-0@lo:503:mount.lustre.0 Request processed in 586us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.813480:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788970663.813634:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788970663.816694:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788970663.816862:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970663.818854:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970663.819042:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387840 00000100:00100000:0.0:1788970663.819053:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387840 00000100:00100000:1.0:1788970663.819180:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788970663.819294:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788970663.819306:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970663.819483:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387840:12345-0@lo:502:mount.lustre.0 Request processed in 180us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.819491:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788970663.819607:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970663.819851:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788970663.819884:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788970663.819910:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788970663.819926:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788970663.819953:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788970663.819982:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788970663.819998:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788970663.820013:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788970663.820023:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788970663.820034:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788970663.820047:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788970663.820080:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970663.820119:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.820759:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0e17540 going to sleep for 11 seconds 00000100:00100000:2.0:1788970663.822196:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102387968 00000100:00100000:2.0:1788970663.822262:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102387968 00000100:00100000:2.0:1788970663.822326:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788970663.822336:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970663.822598:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102387968:12345-0@lo:502:mount.lustre.0 Request processed in 262us (2477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.822606:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788970663.824098:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102387968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788970663.824188:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788970663.824201:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788970663.829872:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970663.829886:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970663.829888:0:25041:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788970663.830280:0:25041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebf3b2800 00000020:00000080:1.0:1788970663.830287:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970663.830296:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970663.830299:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970663.830300:0:25041:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788970663.830303:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970663.830306:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970663.830307:0:25041:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788970663.830320:0:25041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a7ebf3b2800 00000020:00000080:1.0:1788970663.830322:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970663.830535:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788970663.830540:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970663.830541:0:25041:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788970663.830554:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788970663.830558:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788970663.830559:0:25041:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788970663.830563:0:25041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebf3b2800 00000020:00000080:1.0:1788970663.830565:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788970663.838093:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970663.841339:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970663.841345:0:25041:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788970663.841356:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788970663.841363:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970663.841364:0:25041:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788970663.841370:0:25041:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a7ebf3b2800 00000020:00000080:0.0:1788970663.841373:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788970663.841469:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788970663.841473:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788970663.841475:0:25041:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788970663.841478:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788970663.843366:0:25033:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788970663.843438:0:25033:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970663.843456:0:25033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.843468:0:25033:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970663.843524:0:25033:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788970663.843528:0:25033:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a7ebf3b2800 10000000:01000000:3.0:1788970663.843532:0:25033:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a7ebf3b2800 10000000:01000000:3.0:1788970663.843536:0:25033:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788970663.843542:0:25033:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a7ebf3b2800 from 1 10000000:01000000:3.0:1788970663.844890:0:25033:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788970663.844932:0:25033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.844943:0:25033:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.844953:0:25033:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970663.845047:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788970663.845122:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.845171:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e956c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.845845:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388096 00000100:00100000:1.0:1788970663.845854:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388096 00000100:00100000:1.0:1788970663.845899:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788970663.845908:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:25033:x1875871102388096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788970663.845923:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970663.845937:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c7067d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c70676 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.846286:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c7067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c70676 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.846301:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9b600/0xc3abfebe76c7067d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70676 expref: 24 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.846320:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b600, rc 0) 00000100:00100000:1.0:1788970663.846402:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388096:12345-0@lo:101:mount.lustre.0 Request processed in 475us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.846409:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788970663.846884:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788970663.846902:0:25033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7067d expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.846910:0:25033:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c7067d expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970663.850936:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788970663.851904:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970663.853506:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788970663.853537:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788970663.853548:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788970663.853571:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788970663.853583:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788970663.853594:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788970663.853604:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788970663.853615:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788970663.853626:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788970663.853636:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788970663.853647:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788970663.853658:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788970663.853668:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788970663.853678:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788970663.853689:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788970663.853700:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788970663.853710:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788970663.853721:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788970663.853732:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788970663.853758:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788970663.853776:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788970663.853787:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788970663.853798:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788970663.853809:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788970663.853820:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788970663.853830:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788970663.853841:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788970663.853851:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788970663.853862:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788970663.853872:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788970663.853883:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788970663.853893:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788970663.853903:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788970663.853914:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788970663.853924:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788970663.853944:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788970663.853956:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788970663.853966:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788970663.853977:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788970663.853988:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788970663.853999:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788970663.854009:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788970663.854020:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788970663.854030:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788970663.854041:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788970663.854051:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788970663.854062:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788970663.854072:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788970663.854163:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788970663.854180:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788970663.854204:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788970663.854210:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788970663.854319:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788970663.854403:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.854445:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e956c0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788970663.854858:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388224 00000100:00100000:0.0:1788970663.854865:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388224 00000100:00100000:0.0:1788970663.854911:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788970663.854919:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788970663.855053:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388224:12345-0@lo:501:mount.lustre.0 Request processed in 135us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.855061:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788970663.855340:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788970663.859053:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788970663.859233:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.859278:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970663.859418:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388352 00000100:00100000:2.0:1788970663.859426:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388352 00000100:00100000:2.0:1788970663.859479:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788970663.859488:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388352:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788970663.859623:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388352:12345-0@lo:503:mount.lustre.0 Request processed in 135us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.859631:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788970663.859790:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf62d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788970663.860412:0:25033:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788970663.860493:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970663.860540:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.860648:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e956c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788970663.860722:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388480 00000100:00100000:0.0:1788970663.860728:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388480 00000100:00100000:0.0:1788970663.860770:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788970663.860777:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788970663.860866:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388480:12345-0@lo:502:mount.lustre.0 Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.860874:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788970663.862706:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788970663.862932:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788970663.862976:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788970663.862996:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788970663.863010:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788970663.863030:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788970663.863045:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788970663.863060:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788970663.863073:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788970663.863087:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788970663.863101:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788970663.863115:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788970663.863128:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788970663.863141:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788970663.863168:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788970663.863184:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788970663.863198:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788970663.864065:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788970663.864097:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788970663.864115:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788970663.864141:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788970663.864156:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788970663.864170:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788970663.864182:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788970663.864437:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788970663.864459:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788970663.864473:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788970663.864487:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788970663.864501:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788970663.864515:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788970663.865280:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788970663.865330:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788970663.865347:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788970663.865360:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788970663.865376:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788970663.865412:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788970663.865426:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788970663.865439:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788970663.865452:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788970663.865467:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788970663.865481:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788970663.865496:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788970663.865509:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788970663.865524:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788970663.865539:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788970663.866325:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788970663.866365:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788970663.866409:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788970663.866427:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788970663.866487:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970663.867322:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.870424:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e956c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.875120:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388608 00000100:00100000:1.0:1788970663.875137:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388608 00000100:00100000:1.0:1788970663.876213:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788970663.876228:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788970663.881375:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102388608:12345-0@lo:502:mount.lustre.0 Request processed in 5139us (14053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.881470:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970663.881754:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788970663.881786:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788970663.881827:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788970663.881894:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.881928:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d8256c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788970663.882064:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388736 00000100:00100000:3.0:1788970663.882071:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388736 00000100:00100000:3.0:1788970663.882124:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788970663.882134:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:25033:x1875871102388736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788970663.883116:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:25033:x1875871102388736:12345-0@lo:502:mount.lustre.0 Request processed in 980us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970663.883126:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788970663.883318:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788970663.884099:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102388736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788970663.884179:0:25033:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788970663.884194:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788970663.887566:0:25047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788970663.887584:0:25047:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a7e848519c0) 00000020:00000080:3.0:1788970663.887610:0:25047:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788970663.887705:0:25047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7ebf3b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970663.887709:0:25047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7ebf3b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970663.887712:0:25047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebf3b2800 3 00010000:00080000:3.0:1788970663.887743:0:25047:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83f12800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.115@tcp at head 00010000:00010000:3.0:1788970663.895542:0:25047:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788970663.895820:0:25047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788970663.895866:0:25047:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970663.895879:0:25047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3abfebe76c7068b 00000100:00080000:3.0:1788970663.895889:0:25047:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970663.895900:0:25047:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a7d83f12800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970663.895936:0:25047:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7ea1f2fc00 x1875871102388864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970663.895993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102388864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970663.896058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970663.896113:0:25047:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788970663.896175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970663.896179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970663.896182:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970663.896186:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:3.0:1788970663.896196:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788970663.896201:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970663.896227:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830ea580 x1875871102389248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788970663.896655:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388864 00000100:00100000:0.0:1788970663.896664:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388864 00000100:00100000:0.0:1788970663.896697:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970663.896704:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1875871102388864:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788970663.896727:0:22711:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1788970663.896759:0:22711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3abfebe76c70692 00000004:00100000:0.0:1788970663.896772:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788970663.896803:0:22711:0:(import.c:65:import_set_state_nolock()) ffff8a7ebf503000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970663.897233:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102389248:0@lo:8:kworker.0 00000100:00100000:1.0:1788970663.897269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.897336:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389248 00000100:00100000:2.0:1788970663.897341:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389248 00000100:00100000:2.0:1788970663.897366:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788970663.897371:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102389248:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788970663.897436:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102389248:12345-0@lo:8:kworker.0 Request processed in 63us (165us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970663.897444:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788970663.897649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970663.897653:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970663.897656:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970663.897660:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 681 00000100:00080000:3.0:1788970663.897663:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788970663.897669:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebb910000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970663.897685:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d830e92c0 x1875871102389760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970663.897725:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102389504:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.897779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.897819:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970663.897828:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102388992:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897848:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.897865:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.897918:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897937:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.897952:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.897992:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.898006:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788970663.898011:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.898032:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.898042:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.898062:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.898352:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389632 00000100:00100000:2.0:1788970663.898358:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389632 00000100:00100000:2.0:1788970663.898412:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389120 00000100:00100000:2.0:1788970663.898415:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389120 00000100:00100000:2.0:1788970663.898435:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970663.898442:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102389632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970663.898483:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102389632:12345-0@lo:400:kworker.0 Request processed in 41us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.898488:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788970663.898500:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788970663.898505:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970663.898532:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102389120:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.898538:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788970663.898631:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebdb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788970663.898659:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102389632:0@lo:400:kworker.0 00000020:01000004:3.0:1788970663.898758:0:25047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788970663.898775:0:25047:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a7eaef699c0) 00000020:00000080:3.0:1788970663.898794:0:25047:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788970663.898880:0:25047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a7ebf3b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970663.898884:0:25047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a7ebf3b2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788970663.898886:0:25047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a7ebf3b2800 3 00010000:00080000:3.0:1788970663.898912:0:25047:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a7d83f12000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.115@tcp at head 00000100:00100000:2.0:1788970663.900458:0:22713:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788970663.900469:0:22713:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788970663.903443:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875871102388864:12345-0@lo:38:llog_process_th.0 Request processed in 6731us (7377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903457:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788970663.903497:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389504 00000100:00100000:0.0:1788970663.903505:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389504 00000100:00100000:0.0:1788970663.903542:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102388992 00000100:00100000:0.0:1788970663.903545:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102388992 00000100:00100000:0.0:1788970663.903560:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970663.903567:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.903648:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102389504:12345-0@lo:400:kworker.0 Request processed in 80us (5890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903654:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970663.903668:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970663.903674:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.903702:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102388992:12345-0@lo:400:kworker.0 Request processed in 28us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903707:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970663.903723:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390144 00000100:00100000:0.0:1788970663.903727:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390144 00000100:00100000:0.0:1788970663.903745:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389888 00000100:00100000:0.0:1788970663.903748:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389888 00000100:00100000:0.0:1788970663.903758:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389376 00000100:00100000:0.0:1788970663.903761:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389376 00000100:00100000:0.0:1788970663.903770:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390016 00000100:00100000:0.0:1788970663.903773:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390016 00000100:00100000:0.0:1788970663.903785:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970663.903791:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.903820:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102390144:12345-0@lo:400:kworker.0 Request processed in 29us (6019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903826:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970663.903837:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970663.903843:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.903889:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102389888:12345-0@lo:400:kworker.0 Request processed in 46us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903894:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970663.903906:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970663.903917:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102389376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.903944:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875871102389376:12345-0@lo:400:kworker.0 Request processed in 28us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.903950:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788970663.903975:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788970663.903981:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.904006:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875871102390016:12345-0@lo:400:kworker.0 Request processed in 26us (5943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.904012:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788970663.904431:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7ea1f2fc00 x1875871102388864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970663.904443:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970663.904454:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788970663.904461:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788970663.904466:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788970663.904469:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f12800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788970663.904477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3648:1875871102388864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970663.904505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102389760:0@lo:8:kworker.0 00000100:00100000:0.0:1788970663.904528:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ea1f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102388992:0@lo:400:kworker.0 00000100:00100000:0.0:1788970663.906831:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102389504:0@lo:400:kworker.0 00000100:00100000:1.0:1788970663.906849:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788970663.906852:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d830ead00 x1875871102390144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970663.906929:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788970663.906929:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102390144:0@lo:400:kworker.0 00000100:00080000:1.0:1788970663.906936:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970663.906940:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788970663.906943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102389248:0@lo:8:kworker.0 00010000:00080000:0.0:1788970663.907091:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d830e8b40 x1875871102389376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970663.907102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875871102389376:0@lo:400:kworker.0 00010000:00080000:0.0:1788970663.907115:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d830e83c0 x1875871102390016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970663.907124:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3651:1875871102390016:0@lo:400:kworker.0 00010000:00080000:0.0:1788970663.907133:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d830e9a40 x1875871102389888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970663.907141:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102389888:0@lo:400:kworker.0 00000100:00100000:2.0:1788970663.907438:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102389760 00000100:00100000:2.0:1788970663.907450:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102389760 00000100:00100000:2.0:1788970663.907482:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970663.907490:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102389760:12345-0@lo:8:kworker.0 00010000:00010000:3.0:1788970663.908553:0:25047:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1788970663.908749:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3648:x1875871102389760:12345-0@lo:8:kworker.0 Request processed in 1256us (1898us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788970663.908759:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788970663.909093:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788970663.909101:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788970663.909106:0:3648:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788970663.909116:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102389760:0@lo:8:kworker.0 00000020:00000080:3.0:1788970663.909225:0:25047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788970663.909332:0:25047:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788970663.909344:0:25047:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc3abfebe76c706a0 00000100:00080000:3.0:1788970663.909352:0:25047:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788970663.909361:0:25047:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a7d83f12000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970663.909415:0:25047:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee70c0 x1875871102390272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788970663.909435:0:25047:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788970663.909706:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102390272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788970663.909755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970663.909847:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390272 00000100:00100000:2.0:1788970663.909854:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390272 00000100:00100000:2.0:1788970663.909887:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970663.909895:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875871102390272:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788970663.909918:0:22712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000040:00080000:3.0:1788970663.910193:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:00000080:2.0:1788970663.910540:0:22712:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc3abfebe76c706a7 00000004:00100000:2.0:1788970663.910556:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788970663.910588:0:22712:0:(import.c:65:import_set_state_nolock()) ffff8a7d82607800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970663.910652:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875871102390272:12345-0@lo:38:llog_process_th.0 Request processed in 755us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970663.910660:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788970663.910732:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a7d83ee70c0 x1875871102390272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788970673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970663.910742:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788970663.910748:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788970663.910755:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788970663.910760:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788970663.910762:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f12000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788970663.910768:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3648:1875871102390272:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788970663.910848:0:25033:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788970663.910887:0:25033:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788970663.910910:0:25033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7067d expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970663.910922:0:25033:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3400/0xc3abfebe76c70676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c7067d expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788970663.911059:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788970663.911062:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970663.911064:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970663.911065:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970663.911066:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970663.911068:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970663.911069:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970663.911071:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970663.911072:0:25033:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970663.911076:0:25033:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788970663.911079:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788970663.911080:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788970663.911081:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788970663.911082:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788970663.911083:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788970663.911084:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788970663.911085:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788970663.911086:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788970663.911086:0:25033:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788970663.911105:0:25033:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788970663.911121:0:25033:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102390400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788970663.911159:0:25033:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970663.911193:0:25033:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970663.911289:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390400 00000100:00100000:2.0:1788970663.911294:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390400 00000100:00100000:2.0:1788970663.911342:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788970663.911351:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102390400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788970663.911371:0:22704:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788970663.911406:0:22704:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788970663.917802:0:22704:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788970663.917848:0:22704:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788970663.918341:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:25033:x1875871102390400:12345-0@lo:253:mount.lustre.0 Request processed in 6987us (7177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970663.918352:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:1.0:1788970663.918679:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788970663.918685:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788970663.918704:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.918719:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.918726:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.918733:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.918736:0:25033:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:25033:1875871102390400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788970663.918749:0:25033:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788970663.918752:0:25033:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788970663.918754:0:25033:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788970663.918755:0:25033:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788970663.918756:0:25033:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788970663.918757:0:25033:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788970663.918758:0:25033:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788970663.918760:0:25033:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788970663.918761:0:25033:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788970663.918763:0:25033:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1788970663.918765:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1788970663.918775:0:25033:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788970663.918777:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 23 pid: 22705 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970663.918788:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102390528:0@lo:104: 00000100:00100000:1.0:1788970663.918821:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970663.918937:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.918946:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970663.918966:0:22727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102390656:0@lo:104: 00000100:00100000:1.0:1788970663.918998:0:22727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.919015:0:22727:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e86357180 going to sleep for 11 seconds 00000100:00100000:1.0:1788970663.919140:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390528 00000100:00100000:1.0:1788970663.919147:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390528 00000100:00100000:1.0:1788970663.919173:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390656 00000100:00100000:1.0:1788970663.919176:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390656 00000100:00100000:1.0:1788970663.919188:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970663.919196:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102390528:12345-0@lo:104: 00010000:00010000:1.0:1788970663.919207:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919328:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788970663.919335:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:22727:x1875871102390528:12345-0@lo:104: Request processed in 139us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970663.919341:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970663.919355:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788970663.919358:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788970663.919361:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102390656:12345-0@lo:104: 00010000:00010000:0.0:1788970663.919364:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919369:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919371:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83025a00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970663.919375:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919405:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919417:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1788970663.919418:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970663.919422:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf3761c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:22727:x1875871102390656:12345-0@lo:104: Request processed in 62us (424us total) trans 0 rc 0/0 10000000:01000000:0.0:1788970663.919425:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788970663.919427:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788970663.919440:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970663.919444:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919450:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919456:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b200 already unused, calling callback (ffffffffc116cc20) 00010000:00010000:0.0:1788970663.919457:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1788970663.919458:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919465:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970663.919471:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919474:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970663.919476:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788970663.919481:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7d83025a00/0xc3abfebe76c70542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c70549 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970663.919488:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919491:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970663.919493:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970663.919493:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970663.919495:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970663.919506:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.919508:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788970663.919513:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b200/0xc3abfebe76c70534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7053b expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.919518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d845192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102390784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970663.919525:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970663.919526:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970663.919528:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970663.919543:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102390528:0@lo:104: 00000100:00100000:0.0:1788970663.919545:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970663.919550:0:22727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1875871102390656:0@lo:104: 00010000:00010000:1.0:1788970663.919563:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.919569:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102390912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970663.919588:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970663.919647:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390784 00000100:00100000:0.0:1788970663.919650:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390784 00010000:00010000:0.0:1788970663.919666:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 24 pid: 22705 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.919684:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102390912 00000100:00100000:0.0:1788970663.919686:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102390912 00010000:00010000:0.0:1788970663.919712:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 25 pid: 22704 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970663.919731:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970663.919738:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:3649:x1875871102390784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970663.919755:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970663.919760:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 25 pid: 22705 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919770:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 25 pid: 22705 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919781:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83025000/0xc3abfebe76c70549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70542 expref: 25 pid: 22705 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919791:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970663.919817:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3649:x1875871102390784:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.919824:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788970663.919838:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970663.919845:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:3651:x1875871102390912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970663.919852:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970663.919856:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919863:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919873:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5200/0xc3abfebe76c7053b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70534 expref: 23 pid: 22704 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919893:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919901:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788970663.919913:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005391432s 00010000:00010000:0.0:1788970663.919917:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919925:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919931:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919938:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919943:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970663.919947:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.919955:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.920282:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.920292:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970663.920337:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:3651:x1875871102390912:12345-0@lo:103:ldlm_bl.0 Request processed in 492us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970663.920343:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788970663.920530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d845192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102390784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970663.920556:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102390912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970663.920569:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.920577:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970663.920584:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9be00/0xc3abfebe76c706ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788970663.921306:0:25033:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788970663.923895:0:25033:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788970663.923904:0:25033:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788970663.923940:0:25033:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788970663.924055:0:25033:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788970663.924075:0:25033:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788970663.924093:0:25033:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788970663.924868:0:25033:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970663.927367:0:25033:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970664.030288:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788970664.793339:0:25102:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788970664.793745:0:25102:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788970665.052602:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788970665.884915:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788970665.884922:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d81a76800 from 14 10000000:01000000:2.0:1788970665.884927:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788970665.884968:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970665.884979:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970665.884989:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970665.885012:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970665.885073:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970665.885117:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01300 going to sleep for 11 seconds 00000100:00100000:0.0:1788970665.885175:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391040 00000100:00100000:0.0:1788970665.885182:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391040 00000100:00100000:0.0:1788970665.885263:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788970665.885272:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102391040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970665.885285:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970665.885308:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c706bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c706b5 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970665.885330:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c706bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c706b5 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970665.885340:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8c00/0xc3abfebe76c706bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c706b5 expref: 23 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970665.885358:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8c00, rc 0) 00000100:00100000:0.0:1788970665.885417:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102391040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970665.885423:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788970665.885541:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970665.885555:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706bc expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970665.885564:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c706bc expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970665.885622:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788970665.885651:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970665.885672:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e92a01300 going to sleep for 11 seconds 00000100:00100000:2.0:1788970665.885686:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391168 00000100:00100000:2.0:1788970665.885690:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391168 00000100:00100000:2.0:1788970665.886001:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788970665.886013:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102391168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788970665.886030:0:22704:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788970665.886047:0:22704:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788970665.886050:0:22704:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788970665.886124:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102391168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970665.886221:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf612c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788970665.886279:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788970665.886286:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706bc expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886306:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98a00/0xc3abfebe76c706b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706bc expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970665.886316:0:22708:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788970665.886318:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a7d827a9000 from 14 10000000:01000000:3.0:1788970665.886321:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788970665.886340:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886346:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886355:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970665.886370:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970665.886418:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970665.886434:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788970665.886445:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391296 00000100:00100000:3.0:1788970665.886449:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391296 00000100:00100000:3.0:1788970665.886469:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970665.886475:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102391296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970665.886483:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970665.886492:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2800/0xc3abfebe76c706ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c706c3 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886515:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2800/0xc3abfebe76c706ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c706c3 expref: 25 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886524:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2800/0xc3abfebe76c706ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c706c3 expref: 25 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886532:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2800, rc 0) 00000100:00100000:3.0:1788970665.886561:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:22708:x1875871102391296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970665.886568:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788970665.886597:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970665.886607:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706ca expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970665.886616:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c706ca expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970665.886664:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788970665.886691:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970665.886705:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788970665.887063:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391424 00000100:00100000:0.0:1788970665.887068:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391424 00000100:00100000:0.0:1788970665.887089:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788970665.887096:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:22708:x1875871102391424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788970665.887107:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788970665.887120:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788970665.887123:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788970665.887199:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:22708:x1875871102391424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970665.887207:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788970665.887239:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102391424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788970665.887282:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788970665.887288:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706ca expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970665.887308:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3800/0xc3abfebe76c706c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c706ca expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970665.888256:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:3.0:1788970666.078574:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970667.103180:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970667.294167:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788970667.294199:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102391552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970667.294270:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970667.294354:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391552 00000100:00100000:1.0:1788970667.294362:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391552 00000100:00100000:1.0:1788970667.294447:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970667.294458:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102391552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970667.294486:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970667.294534:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf62d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102391552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970667.294540:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788970667.294698:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102391552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788970667.294758:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788970668.127068:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970668.316586:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788970668.316609:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102391680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970668.316673:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970668.316726:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391680 00000100:00100000:2.0:1788970668.316734:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391680 00000100:00100000:2.0:1788970668.316784:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788970668.316793:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102391680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970668.316814:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970668.316855:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102391680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970668.316862:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788970668.316882:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970668.316917:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102391680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970668.830839:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102391808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970668.830922:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970668.830977:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391808 00000100:00100000:2.0:1788970668.830984:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391808 00000100:00100000:2.0:1788970668.831030:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970668.831039:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102391808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970668.831087:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788970668.831134:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102391808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970668.831141:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788970668.831189:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebcf61a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102391808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970668.833586:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788970668.833660:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970668.833979:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102391936 00000100:00100000:1.0:1788970668.833988:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102391936 00000100:00100000:1.0:1788970668.834041:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788970668.834051:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102391936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970668.834157:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970668.834207:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102391936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970668.834227:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788970668.834285:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf375680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102391936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970669.149651:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788970669.300084:0:25391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788970669.340796:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102392064:0@lo:400:kworker.0 00000100:00100000:2.0:1788970669.340866:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788970669.341266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970669.341281:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970669.341285:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970669.341297:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a7d83eff800 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970669.341325:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee4780 x1875871102392320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788970669.343359:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102392576:0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.343456:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970669.343657:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392064 00000100:00100000:2.0:1788970669.343666:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392064 00000100:00100000:2.0:1788970669.343764:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788970669.343775:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3652:x1875871102392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970669.343830:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3652:x1875871102392064:12345-0@lo:400:kworker.0 Request processed in 57us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970669.343837:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788970669.344452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788970669.344459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788970669.344462:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788970669.344472:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a7ebb910000 using connection 192.168.203.115@tcp/0@lo 00000100:00100000:3.0:1788970669.344501:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a7d83ee7840 x1875871102392704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788970669.344732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102392192:0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.344770:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.344800:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102392960:0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.344825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.344845:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788970669.344851:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102392448:0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.344871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.344887:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102393088:0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.344906:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.344932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102392320:0@lo:8:kworker.0 00000100:00100000:3.0:1788970669.344955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.344973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102392704:0@lo:8:kworker.0 00000100:00100000:3.0:1788970669.344992:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.345019:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392576 00000100:00100000:3.0:1788970669.345024:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392576 00000100:00100000:3.0:1788970669.345061:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392192 00000100:00100000:3.0:1788970669.345064:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392192 00000100:00100000:3.0:1788970669.345084:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392320 00000100:00100000:3.0:1788970669.345088:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392320 00000100:00100000:3.0:1788970669.345096:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392704 00000100:00100000:3.0:1788970669.345098:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392704 00000100:00100000:3.0:1788970669.345108:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970669.345115:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102392576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.345156:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875871102392576:12345-0@lo:400:kworker.0 Request processed in 41us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970669.345163:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788970669.345255:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970669.345262:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102392192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970669.345305:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875871102392192:12345-0@lo:400:kworker.0 Request processed in 44us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970669.345311:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788970669.345323:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970669.345327:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102392320:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788970669.345355:0:24366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788970669.345404:0:24366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3abfebe76c706d1 00002000:00100000:3.0:1788970669.345419:0:24366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a7d83f16800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788970669.345424:0:24366:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788970669.345427:0:24366:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788970669.345597:0:24366:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788970669.345619:0:24366:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970669.345657:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875871102392320:12345-0@lo:8:kworker.0 Request processed in 327us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970669.345663:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788970669.345676:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970669.345687:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3648:x1875871102392704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788970669.345703:0:24366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788970669.345718:0:24366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc3abfebe76c706d8 00002000:00100000:3.0:1788970669.345725:0:24366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a7d83f13000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2a ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788970669.345728:0:24366:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788970669.345729:0:24366:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788970669.345749:0:24366:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788970669.345761:0:24366:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f11000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970669.345790:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1875871102392704:12345-0@lo:8:kworker.0 Request processed in 101us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970669.345796:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788970669.346752:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392960 00000100:00100000:0.0:1788970669.346762:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392960 00000100:00100000:0.0:1788970669.346806:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392448 00000100:00100000:0.0:1788970669.346818:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392448 00000100:00100000:0.0:1788970669.346834:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393088 00000100:00100000:0.0:1788970669.346837:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393088 00000100:00100000:0.0:1788970669.346852:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970669.346860:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970669.346908:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875871102392960:12345-0@lo:400:kworker.0 Request processed in 50us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970669.346915:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788970669.346928:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970669.346933:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970669.346959:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875871102392448:12345-0@lo:400:kworker.0 Request processed in 26us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970669.346964:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788970669.346975:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788970669.346981:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102393088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970669.347007:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102393088:12345-0@lo:400:kworker.0 Request processed in 26us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970669.347013:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970669.347257:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102393216:0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347304:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.347344:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3651:1875871102392576:0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347363:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788970669.347370:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102392832:0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347414:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.347431:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102393344:0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347451:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.347473:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393216 00000100:00100000:1.0:1788970669.347477:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393216 00000100:00100000:1.0:1788970669.347514:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102392832 00000100:00100000:1.0:1788970669.347518:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102392832 00000100:00100000:1.0:1788970669.347529:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393344 00000100:00100000:1.0:1788970669.347532:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393344 00000100:00100000:1.0:1788970669.347548:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970669.347554:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347588:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875871102393216:12345-0@lo:400:kworker.0 Request processed in 35us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.347594:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788970669.347606:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970669.347620:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102392832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347649:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf374780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875871102392832:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.347655:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788970669.347668:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788970669.347674:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970669.347700:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875871102393344:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.347706:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788970669.347829:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee43c0 x1875871102392832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.347840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875871102392832:0@lo:400:kworker.0 00010000:00080000:1.0:1788970669.347850:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee52c0 x1875871102393344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.347859:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3651:1875871102393344:0@lo:400:kworker.0 00010000:00080000:1.0:1788970669.347868:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee5680 x1875871102393216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.347876:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3651:1875871102393216:0@lo:400:kworker.0 00000100:00080000:2.0:1788970669.348276:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970669.348282:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788970669.348285:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970669.348311:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102392064:0@lo:400:kworker.0 00010000:00080000:0.0:1788970669.348487:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4780 x1875871102392320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970669.348501:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788970669.348509:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970669.348514:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788970669.348517:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7d83eff800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970669.348542:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970669.348548:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3648:1875871102392320:0@lo:8:kworker.0 00010000:00080000:0.0:1788970669.348796:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee7840 x1875871102392704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788970694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788970669.348806:0:3648:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788970669.348811:0:3648:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788970669.348815:0:3648:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788970669.348817:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8a7ebb910000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788970669.348829:0:3648:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788970669.348833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3648:1875871102392704:0@lo:8:kworker.0 00000004:00080000:0.0:1788970669.348858:0:23456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788970669.348944:0:23456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 688615561482ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788970669.348950:0:23456:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1788970669.349367:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4b40 x1875871102392448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970669.349377:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875871102392448:0@lo:400:kworker.0 00010000:00080000:2.0:1788970669.349412:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee6d00 x1875871102393088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970669.349421:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102393088:0@lo:400:kworker.0 00000100:00100000:2.0:1788970669.349433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102392192:0@lo:400:kworker.0 00010000:00080000:2.0:1788970669.349443:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4f00 x1875871102392960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970669.349451:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3649:1875871102392960:0@lo:400:kworker.0 00000004:00080000:1.0:1788970669.349788:0:22738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1788970669.349812:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1875871102393600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788970669.349862:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.349889:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82fb5f00 going to sleep for 11 seconds 00000004:00080000:1.0:1788970669.349916:0:23457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788970669.349940:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102393856:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788970669.349964:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.349981:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82fb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970669.349993:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788970669.350015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.350034:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788970669.350040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102393728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788970669.350059:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.350087:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393600 00000100:00100000:1.0:1788970669.350093:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393600 00000100:00100000:1.0:1788970669.350135:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393856 00000100:00100000:1.0:1788970669.350138:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393856 00000100:00100000:1.0:1788970669.350160:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970669.350652:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22738:x1875871102393600:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788970669.351094:0:23445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788970669.351749:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393472 00000100:00100000:1.0:1788970669.351756:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393472 00000100:00100000:1.0:1788970669.351784:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393728 00000100:00100000:1.0:1788970669.351788:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393728 00000100:00100000:1.0:1788970669.351803:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970669.351810:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102393472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788970669.351830:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788970669.351896:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875871102393472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.351903:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788970669.351918:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788970669.351925:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875871102393728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788970669.351934:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788970669.351969:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875871102393728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.351975:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788970669.351996:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970669.352011:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788970669.352018:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875871102393856:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:1.0:1788970669.352138:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf374f00 x1875871102393728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.352158:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102393728:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788970669.352171:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7ebf377480 x1875871102393472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788970685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.352184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102393472:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788970669.353314:0:22737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788970669.353425:0:22737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688620043184ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788970669.353432:0:22737:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:0.0:1788970669.356741:0:24221:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788970669.356754:0:24221:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788970669.356760:0:24221:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1788970669.360441:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788970669.360454:0:24220:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788970669.360552:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875871102393856:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8530us (10582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.360563:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788970669.360623:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4f00 x1875871102393856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788970685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.360640:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102393856:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788970669.360654:0:23457:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788970669.360692:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102393984:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788970669.360721:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.360743:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82fb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970669.360760:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102393984 00000100:00100000:1.0:1788970669.360778:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102393984 00000100:00100000:1.0:1788970669.360814:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788970669.360820:0:24219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875871102393984:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788970669.360844:0:24219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788970669.360870:0:24219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23457:x1875871102393984:12345-0@lo:5:osp-pre-1-1.0 Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970669.360876:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788970669.360896:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83ee4f00 x1875871102393984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788970685 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788970669.360906:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102393984:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788970669.360914:0:23457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788970669.360934:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102394112:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788970669.360952:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970669.360963:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82fb5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970669.360972:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394112 00000100:00100000:1.0:1788970669.360975:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394112 00000100:00100000:1.0:1788970669.360992:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788970669.360997:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23457:x1875871102394112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788970669.361017:0:24220:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:3.0:1788970669.361283:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788970669.376026:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970669.376038:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376055:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=688s v=(0 0) 00010000:00010000:0.0:1788970669.376059:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970669.376066:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376084:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376108:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376116:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376138:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.376439:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.376447:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.376467:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.376472:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.376481:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.376500:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.376509:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c706df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.376529:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.376531:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.376532:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970669.376956:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970669.376963:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376974:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=688s v=(0 0) 00010000:00010000:0.0:1788970669.376977:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970669.376982:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.376992:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.377000:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.377007:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.377041:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788970669.377431:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970669.377439:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.377449:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970669.377454:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.377463:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.377480:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.377494:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006400a994/0xc3abfebe76c706e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.377515:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970669.377517:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970669.377519:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.383315:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.383328:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383347:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.383351:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.383357:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383371:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383402:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383410:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383432:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.383443:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.383448:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383455:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.383459:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383468:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383486:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383494:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c706ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.383514:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.383522:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.383523:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.383994:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.384001:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.384010:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.384013:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.384017:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.384027:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.384035:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.384043:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.386343:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788970669.388082:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.388095:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.388113:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.388118:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.388124:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.388148:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.388159:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.388178:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970669.388700:0:25034:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788970669.388713:0:25034:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788970669.388716:0:25034:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788970669.388933:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23457:x1875871102394112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 27931us (27975us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788970669.388944:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788970669.389266:0:23457:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788970669.389285:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23457:1875871102394112:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788970669.389301:0:23457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788970669.389358:0:23457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875871102394240:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788970669.389415:0:23457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970669.389447:0:23457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaeffb780 going to sleep for 11 seconds 00010000:00010000:0.0:1788970669.390463:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970669.390475:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390487:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.390491:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390501:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390520:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390527:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3003e3/0xc3abfebe76c706f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970669.390569:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394240 00000100:00100000:0.0:1788970669.390577:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394240 00000100:00100000:0.0:1788970669.390633:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788970669.390643:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875871102394240:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788970669.390712:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23457:x1875871102394240:12345-0@lo:900:osp-pre-1-1.0 Request processed in 70us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970669.390718:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788970669.390769:0:23457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d830ead00 x1875871102394240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788970685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970669.390782:0:23457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d830ead00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23457:1875871102394240:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1788970669.390806:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.390811:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390818:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.390821:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390830:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390841:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.390849:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.390850:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.390852:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.392021:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788970669.392033:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de90ff3e/0xc3abfebe76c706fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.392935:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.393185:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.393193:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393208:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.393212:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.393219:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393233:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393255:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393264:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393297:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.393478:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.393485:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.393503:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.393507:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.393517:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.393535:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.393543:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ae7318e/0xc3abfebe76c70702 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.393560:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.393562:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.393564:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.393808:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.393814:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393823:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.393827:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.393831:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393840:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393849:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393857:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.393890:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.394007:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.394013:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394021:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.394024:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394032:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394052:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394058:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd2eee52/0xc3abfebe76c70709 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394071:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.394072:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.394074:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.394291:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.394296:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394305:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.394308:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.394312:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394322:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394329:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394336:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394359:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.394551:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.394557:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394565:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed99a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.394569:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394577:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394588:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394595:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d72d4515/0xc3abfebe76c70710 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.394620:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.394621:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.394623:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.394764:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.394770:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394777:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.394785:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.394789:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394798:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394806:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394813:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.394832:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.395058:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.395064:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.395071:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.395074:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.395082:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.395092:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.395100:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015093b75/0xc3abfebe76c70717 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.395115:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.395117:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.395119:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.396037:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.396045:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396055:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.396058:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.396063:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396074:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396082:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396097:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396119:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970669.396246:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.396252:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.396260:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.396264:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.396295:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.396307:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.396315:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c66d83a5/0xc3abfebe76c7071e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.396330:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.396332:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.396334:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.396741:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.396747:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396756:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.396759:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.396762:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396770:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396777:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396784:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.396807:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970669.397023:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.397029:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.397037:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.397041:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.397049:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.397060:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.397076:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c77c603/0xc3abfebe76c70725 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.397091:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.397093:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.397094:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.397161:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.397595:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397611:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.397614:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.397619:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397628:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397637:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397644:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397659:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788970669.397939:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.397945:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397954:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.397957:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.397961:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397970:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397989:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.397995:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.398007:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788970669.398930:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970669.398938:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.398957:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.398962:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.398970:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970669.399047:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.399053:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399061:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.399064:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.399068:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399077:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399085:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399092:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399119:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788970669.399127:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788970669.399131:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399138:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.399141:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399149:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399162:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399195:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399213:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d1d1679/0xc3abfebe76c7072c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399229:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.399233:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399240:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027bc3232/0xc3abfebe76c70733 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399240:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.399243:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399251:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399253:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.399254:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.399256:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.399261:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399284:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080da3bdb/0xc3abfebe76c7073a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.399298:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.399299:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.399301:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.399590:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.399595:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399603:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.399613:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.399617:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399628:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399635:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399642:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399653:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.399662:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.399665:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399672:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.399675:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399682:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399692:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399711:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb03da7c/0xc3abfebe76c70741 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399725:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.399727:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.399729:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.399962:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.399967:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399973:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.399976:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.399980:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399991:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.399998:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400005:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400027:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.400255:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.400262:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400282:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.400286:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400294:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788970669.400301:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788970669.400306:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400313:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068faea67/0xc3abfebe76c70748 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400327:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.400329:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.400330:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.400411:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400419:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.400422:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.400425:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400434:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400441:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400448:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400464:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.400501:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.400507:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400514:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.400518:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400525:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400536:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400544:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f38ee767/0xc3abfebe76c7074f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400677:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.400679:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.400681:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.400706:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.400712:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400720:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.400723:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.400727:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400736:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400750:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400757:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.400777:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.400983:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.400989:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.400997:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.401000:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401016:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401028:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401035:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f23bd82/0xc3abfebe76c70756 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401048:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401050:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401052:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.401117:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.401123:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401131:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.401134:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.401138:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401147:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401154:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401161:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401242:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.401334:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.401339:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401347:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.401350:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401358:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401369:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401422:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8658787/0xc3abfebe76c7075d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401436:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401438:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401440:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788970669.401529:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788970669.401535:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401545:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=688s v=(0 0) 00010000:00010000:2.0:1788970669.401548:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970669.401552:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401561:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401569:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.401575:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.401684:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.401786:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.401791:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401799:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.401803:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401811:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401823:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401830:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000026d90c2/0xc3abfebe76c70764 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.401843:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401844:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.401845:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.402778:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.402787:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.402798:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.402802:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.402806:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.402826:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.402832:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.402836:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.402859:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.402879:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.402885:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.402893:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2200 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.402896:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.402910:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.402921:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.402928:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf4c312a/0xc3abfebe76c7076b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.402943:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.402945:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.402946:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.402980:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.403366:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.403373:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.403399:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.403402:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.403406:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.403417:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.403424:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.403442:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.403461:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.403495:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.403500:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.403508:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.403511:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.403520:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.403531:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.403549:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad41e7b3/0xc3abfebe76c70772 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.403562:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.403564:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.403565:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.404072:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.404079:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404166:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.404175:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.404180:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404190:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404198:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404205:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404225:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788970669.404488:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788970669.404494:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.404502:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.404506:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.404515:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.404528:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.404535:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011bae511/0xc3abfebe76c70779 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.404550:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.404552:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.404554:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.404735:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.404741:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404753:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.404756:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.404761:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404770:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404778:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404785:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.404808:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970669.404826:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.404834:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.404843:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.404847:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.404856:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.404869:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.404876:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bdc1bbb/0xc3abfebe76c70780 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.404892:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.404894:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.404903:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.405374:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.405400:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.405410:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.405414:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.405418:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.405428:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.405446:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.405453:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.405474:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788970669.405526:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.405533:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.405542:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3e00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.405547:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.405557:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.405569:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.405577:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df79cb65/0xc3abfebe76c70787 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.405593:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.405596:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.405597:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.406298:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.406315:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406325:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.406328:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.406333:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406342:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406351:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406358:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406405:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788970669.406886:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.406892:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406902:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.406916:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.406921:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406931:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406939:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406947:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.406969:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970669.407520:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970669.407527:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.407536:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.407541:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788970669.407822:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.407829:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.407838:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.407847:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.407852:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.407862:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.407870:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.407878:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.407898:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788970669.408072:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408169:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408177:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1240f39/0xc3abfebe76c7078e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408199:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970669.408203:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408210:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2c00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.408214:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408222:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408233:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408240:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c99b410/0xc3abfebe76c70795 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408263:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970669.408266:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408284:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3600 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:0.0:1788970669.408287:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408295:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408313:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408320:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008584a73c/0xc3abfebe76c7079c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.408331:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.408333:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.408334:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.408339:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.408341:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970669.408342:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.408819:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788970669.408988:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788970669.408994:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.409015:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=688s v=(0 0) 00010000:00010000:0.0:1788970669.409019:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970669.409023:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.409033:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.409041:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.409048:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970669.409072:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.409230:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.409236:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.409244:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.409248:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.409257:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.409281:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.409289:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011659192/0xc3abfebe76c707a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.409304:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.409306:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.409307:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.409858:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.409864:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.409873:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.409876:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.409881:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.409891:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.409899:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.409911:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.409933:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788970669.410045:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970669.410051:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.410059:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:1.0:1788970669.410063:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.410080:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.410091:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.410098:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f233d494/0xc3abfebe76c707aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970669.410112:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.410114:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970669.410115:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788970669.410546:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788970669.410663:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.410673:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788970669.410677:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788970669.410681:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.410690:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.410699:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.410707:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970669.410729:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788970669.410764:0:24221:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1788970669.410858:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22738:x1875871102393600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60687us (60992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970669.410873:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788970669.411037:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf376d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1875871102393600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788970669.411054:0:22738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00010000:00010000:2.0:1788970669.411057:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788970669.411096:0:22738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee7c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1875871102394368:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788970669.411130:0:22738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970669.411807:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.411818:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2a00 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970669.411822:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.411831:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.411846:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.411853:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004de9b24/0xc3abfebe76c707b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970669.411872:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.411873:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788970669.411875:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970669.412873:0:22738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7d82160f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788970669.413918:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394368 00000100:00100000:3.0:1788970669.413934:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394368 00000100:00100000:3.0:1788970669.413999:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788970669.414009:0:24219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22738:x1875871102394368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788970669.414051:0:24219:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1788970669.417813:0:24219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22738:x1875871102394368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3799us (6676us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788970669.417827:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788970669.417945:0:22738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee7c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1875871102394368:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788970669.417962:0:22738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000020:00000004:1.0:1788970670.073900:0:25443:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970670.074112:0:25443:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788970670.172909:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970670.495010:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788970670.750151:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788970670.875070:0:25494:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788970670.875326:0:25494:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788970671.120088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.121552:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365568 00000100:00100000:2.0:1788970671.121566:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365568 00000100:00100000:3.0:1788970671.121807:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:3.0:1788970671.121816:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1875871082365568:12345-192.168.203.15@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788970671.121843:0:22704:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 934ded50-4656-4f1c-aa47-e2fbf1604b86@192.168.203.15@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788970671.121871:0:22704:0:(genops.c:1384:class_connect()) connect: client 934ded50-4656-4f1c-aa47-e2fbf1604b86, cookie 0xc3abfebe76c707b8 00000100:00080000:3.0:1788970671.122002:0:22704:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f16000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970671.122075:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+5:2399:x1875871082365568:12345-192.168.203.15@tcp:250:mount.lustre.0 Request processed in 258us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.122084:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 113 00000100:00100000:1.0:1788970671.129596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.129810:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365696 00000100:00100000:2.0:1788970671.129821:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365696 00000100:00100000:2.0:1788970671.129929:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:2.0:1788970671.129939:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+5:18081:x1875871082365696:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970671.129956:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970671.129974:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c707bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd2b expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970671.130003:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c707bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd2b expref: 6 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970671.130017:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655600/0xc3abfebe76c707bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd2b expref: 6 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970671.130026:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655600, rc 0) 00000100:00100000:2.0:1788970671.130090:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+6:18081:x1875871082365696:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 152us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.130097:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 114 00000100:00100000:0.0:1788970671.135584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970671.135853:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365824 00000100:00100000:3.0:1788970671.135864:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365824 00000100:00100000:3.0:1788970671.135924:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:3.0:1788970671.135934:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d827ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+6:18081:x1875871082365824:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788970671.136067:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d827ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+6:18081:x1875871082365824:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 134us (492us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788970671.136077:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 115 00000100:00100000:2.0:1788970671.146734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.147033:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082365952 00000100:00100000:0.0:1788970671.147044:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082365952 00000100:00100000:0.0:1788970671.147104:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:0.0:1788970671.147114:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+6:18081:x1875871082365952:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788970671.147133:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970671.147151:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c707c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd32 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970671.147179:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c707c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd32 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970671.147204:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8e00/0xc3abfebe76c707c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd32 expref: 7 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970671.147213:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8e00, rc 0) 00000100:00100000:0.0:1788970671.148034:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+7:18081:x1875871082365952:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 817us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970671.148044:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 116 00000100:00100000:2.0:1788970671.159046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.159155:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366080 00000100:00100000:1.0:1788970671.159178:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366080 00000100:00100000:1.0:1788970671.159234:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970671.159410:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+7:18081:x1875871082366080:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788970671.159616:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18081:x1875871082366080:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 372us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.159624:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 117 00000100:00100000:1.0:1788970671.163461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.163560:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366208 00000100:00100000:0.0:1788970671.163570:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366208 00000100:00100000:0.0:1788970671.163660:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:0.0:1788970671.163671:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18081:x1875871082366208:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970671.163830:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18081:x1875871082366208:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970671.163839:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 118 00000100:00100000:2.0:1788970671.168136:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970671.168236:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366336 00000100:00100000:3.0:1788970671.168246:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366336 00000100:00100000:3.0:1788970671.168315:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:3.0:1788970671.168335:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366336:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788970671.168534:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366336:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 202us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.168542:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 119 00000100:00100000:2.0:1788970671.201130:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.201283:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366464 00000100:00100000:0.0:1788970671.201293:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366464 00000100:00100000:0.0:1788970671.201350:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 120 00000100:00100000:0.0:1788970671.201360:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366464:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788970671.201539:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366464:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 180us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970671.201548:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 120 00010000:00010000:1.0:1788970671.202813:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970671.209673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.210435:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366592 00000100:00100000:1.0:1788970671.210446:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366592 00000100:00100000:1.0:1788970671.210533:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:1.0:1788970671.210545:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366592:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970671.210707:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18099:x1875871082366592:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 164us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.210715:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 121 00000100:00100000:2.0:1788970671.218227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970671.218328:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366720 00000100:00100000:3.0:1788970671.218339:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366720 00000100:00100000:3.0:1788970671.218435:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:3.0:1788970671.218447:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+8:18081:x1875871082366720:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788970671.218464:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970671.218481:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2e00/0xc3abfebe76c707cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd63 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970671.218508:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2e00/0xc3abfebe76c707cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd63 expref: 9 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970671.218519:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2e00/0xc3abfebe76c707cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd63 expref: 9 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970671.218527:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2e00, rc 0) 00000100:00100000:3.0:1788970671.218573:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+9:18081:x1875871082366720:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.218580:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 122 00000100:00100000:3.0:1788970671.223116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.223571:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366848 00000100:00100000:2.0:1788970671.223582:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366848 00000100:00100000:2.0:1788970671.223640:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:2.0:1788970671.223651:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+9:18081:x1875871082366848:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788970671.223675:0:22703:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788970671.223699:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788970671.223704:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788970671.223713:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788970671.223716:0:22703:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788970671.223718:0:22703:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788970671.228070:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+9:18081:x1875871082366848:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 4409us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.228085:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 123 00000100:00100000:0.0:1788970671.232926:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.233071:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082366976 00000100:00100000:1.0:1788970671.233081:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082366976 00000100:00100000:1.0:1788970671.233139:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:1.0:1788970671.233149:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+9:18081:x1875871082366976:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788970671.233176:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970671.233195:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd6a expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.233222:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.233233:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 10 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.233272:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ac00, rc 0) 00000100:00100000:1.0:1788970671.233536:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18081:x1875871082366976:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 387us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.233544:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 124 00000100:00100000:2.0:1788970671.236503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.236598:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367104 00000100:00100000:0.0:1788970671.236621:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367104 00000100:00100000:0.0:1788970671.236679:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:0.0:1788970671.236690:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18081:x1875871082367104:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788970671.236893:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18081:x1875871082367104:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 204us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970671.236902:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 125 00000100:00100000:0.0:1788970671.240281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970671.240607:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367232 00000100:00100000:3.0:1788970671.240629:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367232 00000100:00100000:2.0:1788970671.240849:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:2.0:1788970671.240859:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18081:x1875871082367232:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788970671.241496:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18081:x1875871082367232:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 635us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.241505:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 126 00000100:00100000:2.0:1788970671.245508:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.245618:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367360 00000100:00100000:1.0:1788970671.245628:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367360 00000100:00100000:1.0:1788970671.245681:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:1.0:1788970671.245691:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18103:x1875871082367360:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970671.245877:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafbc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18103:x1875871082367360:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 186us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.245885:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 127 00000100:00100000:0.0:1788970671.249671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.249752:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367488 00000100:00100000:2.0:1788970671.249761:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367488 00000100:00100000:2.0:1788970671.249811:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:2.0:1788970671.249819:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18103:x1875871082367488:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970671.250101:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18103:x1875871082367488:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 282us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.250108:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 128 00000100:00100000:2.0:1788970671.253037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.253139:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367616 00000100:00100000:1.0:1788970671.253149:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367616 00000100:00100000:1.0:1788970671.253201:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:1.0:1788970671.253209:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875871082367616:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788970671.253240:0:22713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 55e5d094-8e05-444c-a3e2-d2016031d5b4@192.168.203.15@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1788970671.253301:0:22713:0:(genops.c:1384:class_connect()) connect: client 55e5d094-8e05-444c-a3e2-d2016031d5b4, cookie 0xc3abfebe76c707db 00000004:00100000:1.0:1788970671.253337:0:22713:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788970671.253583:0:22713:0:(import.c:65:import_set_state_nolock()) ffff8a7d831db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970671.253656:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2399:x1875871082367616:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 445us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.253664:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:0.0:1788970671.254190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.254263:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367872 00000100:00100000:1.0:1788970671.254269:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367872 00000100:00100000:1.0:1788970671.254542:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:1.0:1788970671.254550:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875871082367872:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788970671.254575:0:25049:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 55e5d094-8e05-444c-a3e2-d2016031d5b4@192.168.203.15@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1788970671.254616:0:25049:0:(genops.c:1384:class_connect()) connect: client 55e5d094-8e05-444c-a3e2-d2016031d5b4, cookie 0xc3abfebe76c707e2 00000004:00100000:1.0:1788970671.254638:0:25049:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788970671.254834:0:25049:0:(import.c:65:import_set_state_nolock()) ffff8a7d831dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788970671.254888:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2399:x1875871082367872:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 337us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.256232:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1788970671.257137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.257278:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082367744 00000100:00100000:1.0:1788970671.257288:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082367744 00000100:00100000:1.0:1788970671.257571:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970671.257582:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:0:x1875871082367744:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788970671.257621:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788970671.257730:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:0:x1875871082367744:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 149us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.257737:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00080000:2.0:1788970671.257890:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970671.259046:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.259132:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.259430:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368128 00000100:00100000:2.0:1788970671.259438:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368128 00000100:00100000:2.0:1788970671.259478:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368000 00000100:00100000:2.0:1788970671.259480:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368000 00000100:00100000:2.0:1788970671.259510:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970671.259526:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368128:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788970671.259552:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788970671.259601:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368128:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 75us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.259607:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970671.259623:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1788970671.259628:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:0:x1875871082368000:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788970671.259645:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788970671.259683:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d845192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:0:x1875871082368000:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 55us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.259688:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00080000:0.0:1788970671.260116:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970671.272130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.272205:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368256 00000100:00100000:2.0:1788970671.272214:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368256 00000100:00100000:2.0:1788970671.272279:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1788970671.272289:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368256:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788970671.272471:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d84519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368256:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 183us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970671.272479:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 12 00000100:00100000:2.0:1788970671.275932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.275973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970671.276006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970671.276089:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368384 00000100:00100000:3.0:1788970671.276099:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368384 00000100:00100000:3.0:1788970671.276143:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368512 00000100:00100000:3.0:1788970671.276147:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368512 00000100:00100000:3.0:1788970671.276169:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1788970671.276176:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082368384:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788970671.276211:0:24221:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 55e5d094-8e05-444c-a3e2-d2016031d5b4@192.168.203.15@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788970671.276242:0:24221:0:(genops.c:1384:class_connect()) connect: client 55e5d094-8e05-444c-a3e2-d2016031d5b4, cookie 0xc3abfebe76c707e9 00002000:00100000:3.0:1788970671.276254:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 55e5d094-8e05-444c-a3e2-d2016031d5b4/ffff8a7d83f17000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970671.276285:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788970671.276507:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788970671.276539:0:24221:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f10800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970671.276604:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2399:x1875871082368384:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 426us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.276611:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1788970671.276630:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970671.276634:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebcf612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082368512:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788970671.276651:0:24221:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 55e5d094-8e05-444c-a3e2-d2016031d5b4@192.168.203.15@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788970671.276668:0:24221:0:(genops.c:1384:class_connect()) connect: client 55e5d094-8e05-444c-a3e2-d2016031d5b4, cookie 0xc3abfebe76c707f0 00002000:00100000:3.0:1788970671.276673:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 55e5d094-8e05-444c-a3e2-d2016031d5b4/ffff8a7d83f15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970671.276684:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788970671.276781:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788970671.276797:0:24221:0:(import.c:65:import_set_state_nolock()) ffff8a7d83f15800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970671.276822:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebcf612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2399:x1875871082368512:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 186us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.276836:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970671.277098:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368640 00000100:00100000:0.0:1788970671.277105:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368640 00000100:00100000:0.0:1788970671.277153:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:0.0:1788970671.277161:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368640:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788970671.277206:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368640:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 45us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970671.277214:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970671.281441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970671.281544:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368768 00000100:00100000:0.0:1788970671.281555:0:22714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368768 00000100:00100000:0.0:1788970671.281614:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970671.281624:0:22714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368768:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788970671.286852:0:22714:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5147us 00000004:00200000:3.0:1788970671.294532:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788970671.294669:0:22714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18081:x1875871082368768:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 13041us (13233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970671.294682:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:3.0:1788970671.491598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970671.491713:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082368896 00000100:00100000:1.0:1788970671.491729:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082368896 00000100:00100000:1.0:1788970671.491816:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 13 00000100:00100000:1.0:1788970671.491826:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18127:x1875871082368896:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:1.0:1788970671.491847:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970671.491872:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c707f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dd9b expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.491939:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.491967:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.491981:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970671.492035:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788970671.492039:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970671.492072:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.492097:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c707f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd9b expref: 8 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.492115:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd9b expref: 7 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970671.492123:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:1.0:1788970671.492126:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970671.492130:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9aa00, rc 0) 00000100:00100000:1.0:1788970671.492201:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18127:x1875871082368896:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 377us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970671.492208:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 13 00010000:00010000:2.0:1788970672.221334:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970672.413781:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788970672.413803:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102394496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788970672.413867:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970672.415509:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394496 00000100:00100000:1.0:1788970672.415523:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394496 00000100:00100000:1.0:1788970672.415666:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788970672.415676:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d830ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102394496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788970672.415699:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788970672.415817:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d830ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102394496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970672.415824:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788970672.419518:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970672.419673:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102394496:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788970673.244737:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970673.436684:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970673.436707:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102394624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788970673.436775:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970673.436984:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394624 00000100:00100000:2.0:1788970673.436993:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394624 00000100:00100000:2.0:1788970673.437073:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788970673.437083:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102394624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970673.437112:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788970673.437432:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970673.437512:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102394624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 429us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.437520:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788970673.437607:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102394624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788970673.500824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.501020:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369024 00000100:00100000:2.0:1788970673.501030:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369024 00000100:00100000:2.0:1788970673.501096:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:2.0:1788970673.501107:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebdb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18179:x1875871082369024:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:2.0:1788970673.501145:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788970673.501234:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebdb6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18179:x1875871082369024:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 130us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.501252:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00080000:0.0:1788970673.501313:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970673.505111:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.505209:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369152 00000100:00100000:1.0:1788970673.505223:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369152 00000100:00100000:1.0:1788970673.505313:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:1.0:1788970673.505324:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369152:12345-192.168.203.15@tcp:41:lfs.0 00000004:00000024:1.0:1788970673.505370:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788970673.505690:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970673.505729:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369152:12345-192.168.203.15@tcp:41:lfs.0 Request processed in 406us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.505737:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:3.0:1788970673.516201:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.517299:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369280 00000100:00100000:1.0:1788970673.517313:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369280 00000100:00100000:1.0:1788970673.517428:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:1.0:1788970673.517441:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369280:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:1.0:1788970673.517469:0:24222:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788970673.517699:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970673.517845:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369280:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 406us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.517852:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:3.0:1788970673.521894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.522194:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369408 00000100:00100000:2.0:1788970673.522204:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369408 00000100:00100000:2.0:1788970673.522318:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1788970673.522328:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369408:12345-192.168.203.15@tcp:13:lfs.0 00002000:00000024:2.0:1788970673.522362:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970673.522508:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18179:x1875871082369408:12345-192.168.203.15@tcp:13:lfs.0 Request processed in 180us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.522516:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00080000:0.0:1788970673.524419:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970673.684870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.686713:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369536 00000100:00100000:0.0:1788970673.686730:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369536 00000100:00100000:0.0:1788970673.686805:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:0.0:1788970673.686816:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+10:18210:x1875871082369536:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788970673.686833:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970673.686851:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a8000/0xc3abfebe76c70805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dda2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970673.686880:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a8000/0xc3abfebe76c70805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dda2 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970673.686893:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a8000/0xc3abfebe76c70805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dda2 expref: 11 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970673.686901:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8000, rc 0) 00000100:00100000:0.0:1788970673.686967:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082369536:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 153us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.686975:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 129 00000100:00100000:3.0:1788970673.692973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.693100:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369664 00000100:00100000:2.0:1788970673.693114:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369664 00000100:00100000:2.0:1788970673.693222:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:2.0:1788970673.693235:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082369664:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788970673.693513:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082369664:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 279us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.693522:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 130 00000100:00100000:3.0:1788970673.698554:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.698669:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369792 00000100:00100000:1.0:1788970673.698686:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369792 00000100:00100000:1.0:1788970673.698774:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:1.0:1788970673.698786:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082369792:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788970673.698929:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082369792:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 145us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.698937:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 131 00000100:00100000:3.0:1788970673.704727:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.709557:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082369920 00000100:00100000:0.0:1788970673.709579:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082369920 00000100:00100000:0.0:1788970673.709682:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:0.0:1788970673.709694:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082369920:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788970673.709933:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082369920:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 240us (5220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.709955:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 132 00000100:00100000:3.0:1788970673.742066:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.742261:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370048 00000100:00100000:2.0:1788970673.742276:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370048 00000100:00100000:2.0:1788970673.742342:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:2.0:1788970673.742354:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082370048:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970673.742597:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082370048:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 244us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.742606:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 133 00000100:00100000:3.0:1788970673.748054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.750410:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370176 00000100:00100000:1.0:1788970673.750432:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370176 00000100:00100000:1.0:1788970673.750523:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:1.0:1788970673.750535:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082370176:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788970673.750744:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18217:x1875871082370176:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 210us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.750753:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 134 00000100:00100000:1.0:1788970673.757483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.757786:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370304 00000100:00100000:2.0:1788970673.757799:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370304 00000100:00100000:2.0:1788970673.757872:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:2.0:1788970673.757883:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18210:x1875871082370304:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970673.757905:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970673.757929:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c7080c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8ddd3 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.757966:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c7080c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddd3 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.757979:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655c00/0xc3abfebe76c7080c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddd3 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.757989:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655c00, rc 0) 00000100:00100000:2.0:1788970673.758087:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18210:x1875871082370304:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 205us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.758095:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 135 00000100:00100000:3.0:1788970673.763655:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.763747:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370432 00000100:00100000:1.0:1788970673.763761:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370432 00000100:00100000:1.0:1788970673.763833:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:1.0:1788970673.763845:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18210:x1875871082370432:12345-192.168.203.15@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788970673.763878:0:22705:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788970673.763915:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788970673.763920:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788970673.763923:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788970673.763926:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788970673.763928:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788970673.769057:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18210:x1875871082370432:12345-192.168.203.15@tcp:256:mount.lustre.0 Request processed in 5198us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.769077:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 136 00000100:00100000:3.0:1788970673.771820:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.771940:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370560 00000100:00100000:2.0:1788970673.771952:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370560 00000100:00100000:2.0:1788970673.772018:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:2.0:1788970673.772031:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18210:x1875871082370560:12345-192.168.203.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788970673.772051:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970673.772074:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8ddda expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.772122:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.772136:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970673.772155:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:2.0:1788970673.772231:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18210:x1875871082370560:12345-192.168.203.15@tcp:101:mount.lustre.0 Request processed in 203us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.772246:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 137 00000100:00100000:3.0:1788970673.774469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.775440:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370688 00000100:00100000:1.0:1788970673.775454:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370688 00000100:00100000:1.0:1788970673.775528:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:1.0:1788970673.775539:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18210:x1875871082370688:12345-192.168.203.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788970673.775760:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18210:x1875871082370688:12345-192.168.203.15@tcp:501:mount.lustre.0 Request processed in 222us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.775770:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 138 00000100:00100000:3.0:1788970673.777897:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.780355:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370816 00000100:00100000:0.0:1788970673.780375:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370816 00000100:00100000:0.0:1788970673.780550:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:0.0:1788970673.780563:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18210:x1875871082370816:12345-192.168.203.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788970673.780775:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18210:x1875871082370816:12345-192.168.203.15@tcp:503:mount.lustre.0 Request processed in 214us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.780783:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 139 00000100:00100000:3.0:1788970673.790597:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.790716:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082370944 00000100:00100000:2.0:1788970673.790729:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082370944 00000100:00100000:2.0:1788970673.790809:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:2.0:1788970673.790821:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18223:x1875871082370944:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788970673.791024:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18223:x1875871082370944:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 205us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.791045:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 140 00000100:00100000:3.0:1788970673.797529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.797650:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371072 00000100:00100000:0.0:1788970673.797664:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371072 00000100:00100000:0.0:1788970673.797734:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:0.0:1788970673.797746:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18223:x1875871082371072:12345-192.168.203.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788970673.797947:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18223:x1875871082371072:12345-192.168.203.15@tcp:502:llog_process_th.0 Request processed in 203us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.797956:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 141 00000100:00100000:3.0:1788970673.801333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970673.801430:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.801639:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371200 00000100:00100000:2.0:1788970673.801658:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371200 00000100:00100000:2.0:1788970673.801704:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371456 00000100:00100000:2.0:1788970673.801707:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371456 00000100:00100000:2.0:1788970673.801734:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970673.801743:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875871082371200:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970673.801783:0:22712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3c393749-293e-4642-ade1-b2d863b30114@192.168.203.15@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1788970673.801862:0:22712:0:(genops.c:1384:class_connect()) connect: client 3c393749-293e-4642-ade1-b2d863b30114, cookie 0xc3abfebe76c7081a 00000004:00100000:2.0:1788970673.801895:0:22712:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788970673.802015:0:22712:0:(import.c:65:import_set_state_nolock()) ffff8a7d82602800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970673.802102:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+6:2399:x1875871082371200:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 357us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.802110:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970673.802133:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:2.0:1788970673.802209:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875871082371456:12345-192.168.203.15@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788970673.802227:0:22712:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 3c393749-293e-4642-ade1-b2d863b30114@192.168.203.15@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1788970673.802263:0:22712:0:(genops.c:1384:class_connect()) connect: client 3c393749-293e-4642-ade1-b2d863b30114, cookie 0xc3abfebe76c70821 00000004:00100000:2.0:1788970673.802278:0:22712:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788970673.802327:0:22712:0:(import.c:65:import_set_state_nolock()) ffff8a7d82603800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788970673.802352:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+6:2399:x1875871082371456:12345-192.168.203.15@tcp:38:mount.lustre.0 Request processed in 143us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.802359:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970673.806559:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970673.806605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970673.806638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.806744:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371584 00000100:00100000:0.0:1788970673.806756:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371584 00000100:00100000:0.0:1788970673.806846:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371328 00000100:00100000:0.0:1788970673.806850:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371328 00000100:00100000:0.0:1788970673.806867:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371712 00000100:00100000:0.0:1788970673.806869:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371712 00000100:00100000:0.0:1788970673.806883:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1788970673.806894:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:0:x1875871082371584:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970673.806945:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788970673.807029:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:0:x1875871082371584:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 136us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.807055:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:0.0:1788970673.807077:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970673.807084:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+7:0:x1875871082371328:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970673.807104:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970673.807146:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+7:0:x1875871082371328:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 50us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.807154:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:0.0:1788970673.807166:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:0.0:1788970673.807173:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082371712:12345-192.168.203.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788970673.807184:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788970673.807204:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082371712:12345-192.168.203.15@tcp:41:mount.lustre.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.807210:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00080000:3.0:1788970673.807510:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788970673.807515:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788970673.809750:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.809941:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371840 00000100:00100000:0.0:1788970673.809955:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371840 00000100:00100000:0.0:1788970673.810028:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970673.810040:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082371840:12345-192.168.203.15@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788970673.810365:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082371840:12345-192.168.203.15@tcp:40:mount.lustre.0 Request processed in 326us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.810374:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:3.0:1788970673.819769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970673.820052:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082371968 00000100:00100000:0.0:1788970673.820065:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082371968 00000100:00100000:0.0:1788970673.820131:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:0.0:1788970673.820150:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875871082371968:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788970673.820211:0:24221:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c393749-293e-4642-ade1-b2d863b30114@192.168.203.15@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:0.0:1788970673.820264:0:24221:0:(genops.c:1384:class_connect()) connect: client 3c393749-293e-4642-ade1-b2d863b30114, cookie 0xc3abfebe76c70828 00002000:00100000:0.0:1788970673.820279:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c393749-293e-4642-ade1-b2d863b30114/ffff8a7d844be800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788970673.820293:0:24221:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788970673.820752:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788970673.820799:0:24221:0:(import.c:65:import_set_state_nolock()) ffff8a7d844bb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788970673.820926:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+6:2399:x1875871082371968:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 776us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970673.820936:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:2.0:1788970673.829464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970673.829536:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.829632:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372224 00000100:00100000:1.0:1788970673.829645:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372224 00000100:00100000:1.0:1788970673.829713:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:1.0:1788970673.829732:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082372224:12345-192.168.203.15@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788970673.829823:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082372224:12345-192.168.203.15@tcp:900:mount.lustre.0 Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.829831:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:3.0:1788970673.830021:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372096 00000100:00100000:3.0:1788970673.830027:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372096 00000100:00100000:3.0:1788970673.830063:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:3.0:1788970673.830070:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875871082372096:12345-192.168.203.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788970673.830106:0:24366:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c393749-293e-4642-ade1-b2d863b30114@192.168.203.15@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1788970673.830370:0:24366:0:(genops.c:1384:class_connect()) connect: client 3c393749-293e-4642-ade1-b2d863b30114, cookie 0xc3abfebe76c7082f 00002000:00100000:3.0:1788970673.830506:0:24366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c393749-293e-4642-ade1-b2d863b30114/ffff8a7d83525800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788970673.830520:0:24366:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788970673.830601:0:24366:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788970673.830641:0:24366:0:(import.c:65:import_set_state_nolock()) ffff8a7d83527800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788970673.830684:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c393749-293e-4642-ade1-b2d863b30114+6:2399:x1875871082372096:12345-192.168.203.15@tcp:8:mount.lustre.0 Request processed in 613us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970673.830693:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1788970673.833540:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970673.833658:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372352 00000100:00100000:3.0:1788970673.833670:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372352 00000100:00100000:3.0:1788970673.833749:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1788970673.833761:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082372352:12345-192.168.203.15@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788970673.833877:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788970673.833999:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+6:18210:x1875871082372352:12345-192.168.203.15@tcp:33:mount.lustre.0 Request processed in 240us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970673.834007:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:1.0:1788970673.948562:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788970673.948592:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102394752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970673.948868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970673.949252:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394752 00000100:00100000:3.0:1788970673.949263:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394752 00000100:00100000:2.0:1788970673.949282:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970673.949294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102394880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788970673.949329:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970673.949340:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102394752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788970673.949375:0:23454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788970673.949454:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102394752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970673.949460:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970673.949461:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788970673.949477:0:23454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102394880 00000100:00100000:3.0:1788970673.949480:0:23454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102394880 00000100:00100000:3.0:1788970673.949500:0:23454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788970673.949505:0:23454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102394880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788970673.949518:0:23454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788970673.949521:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102394752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788970673.949549:0:23454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102394880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970673.949555:0:23454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788970673.949571:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102394880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788970673.977531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970673.977697:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372480 00000100:00100000:1.0:1788970673.977711:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372480 00000100:00100000:1.0:1788970673.977838:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:1.0:1788970673.977850:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c393749-293e-4642-ade1-b2d863b30114+6:18246:x1875871082372480:12345-192.168.203.15@tcp:101:mkdir.0 00010000:00010000:1.0:1788970673.977876:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970673.977901:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c70836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de0b expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.977976:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.978009:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.978025:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970673.978090:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788970673.978094:0:25049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970673.978115:0:25049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.978159:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c70836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 8 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.978181:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 7 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970673.978190:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:1.0:1788970673.978194:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970673.978198:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ba00, rc 0) 00000100:00100000:1.0:1788970673.978294:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c393749-293e-4642-ade1-b2d863b30114+7:18246:x1875871082372480:12345-192.168.203.15@tcp:101:mkdir.0 Request processed in 445us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970673.978301:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:1.0:1788970674.269549:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970674.460834:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102395008:0@lo:400:kworker.0 00000100:00100000:3.0:1788970674.460905:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.461171:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395008 00000100:00100000:2.0:1788970674.461180:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395008 00000100:00100000:2.0:1788970674.461229:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788970674.461251:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3651:x1875871102395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.465520:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3651:x1875871102395008:12345-0@lo:400:kworker.0 Request processed in 4261us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970674.465537:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788970674.465658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102395264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970674.465712:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.465757:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395264 00000100:00100000:2.0:1788970674.465765:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395264 00000100:00100000:2.0:1788970674.465821:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970674.465830:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102395264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788970674.465851:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970674.465894:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875871102395264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970674.465900:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788970674.465951:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3649:1875871102395264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788970674.466539:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970674.466595:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102395136:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.466630:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.466707:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102395392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970674.466736:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.466764:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395392 00000100:00100000:2.0:1788970674.466769:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395392 00000100:00100000:2.0:1788970674.466804:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970674.466812:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102395392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970674.466826:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970674.466859:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102395392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970674.466866:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788970674.466883:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788970674.466905:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102395392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970674.466935:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395136 00000100:00100000:2.0:1788970674.466939:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395136 00000100:00100000:2.0:1788970674.466965:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970674.466971:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.467006:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102395136:12345-0@lo:400:kworker.0 Request processed in 35us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970674.467012:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788970674.467037:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102395136:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467470:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102395776:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970674.467549:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102395904:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467572:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970674.467603:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395776 00000100:00100000:0.0:1788970674.467607:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395776 00000100:00100000:0.0:1788970674.467636:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395904 00000100:00100000:0.0:1788970674.467639:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395904 00000100:00100000:0.0:1788970674.467664:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970674.467671:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102395776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467710:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83569a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875871102395776:12345-0@lo:400:kworker.0 Request processed in 38us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.467715:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788970674.467730:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788970674.467735:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102395904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467778:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d835692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875871102395904:12345-0@lo:400:kworker.0 Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.467784:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788970674.467802:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970674.467821:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875871102395776:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3650:1875871102395904:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467887:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102396288:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.467911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970674.468061:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396288 00000100:00100000:0.0:1788970674.468065:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396288 00000100:00100000:0.0:1788970674.468093:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788970674.468100:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.468133:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875871102396288:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.468140:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788970674.468155:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788970674.468171:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d83568000 x1875871102396288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970674.468182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3649:1875871102396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.471773:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102395648:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.471852:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.471904:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102396160:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.471938:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.471963:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788970674.471969:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102395520:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.472008:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.472024:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102396032:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.472042:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970674.472073:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395648 00000100:00100000:2.0:1788970674.472082:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395648 00000100:00100000:0.0:1788970674.472225:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396160 00000100:00100000:0.0:1788970674.472230:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396160 00000100:00100000:0.0:1788970674.472272:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102395520 00000100:00100000:0.0:1788970674.472275:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102395520 00000100:00100000:0.0:1788970674.472286:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396032 00000100:00100000:0.0:1788970674.472288:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396032 00000100:00100000:0.0:1788970674.472303:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970674.472319:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.472377:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875871102396160:12345-0@lo:400:kworker.0 Request processed in 60us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.472407:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788970674.472426:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970674.472432:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102395520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.472460:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102395520:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.472466:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788970674.472477:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788970674.472482:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102396032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.472521:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875871102396032:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970674.472527:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788970674.472547:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788970674.472551:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788970674.472554:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970674.472771:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102395520:0@lo:400:kworker.0 00010000:00080000:0.0:1788970674.472783:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d8356a580 x1875871102396032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970674.472794:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3652:1875871102396032:0@lo:400:kworker.0 00000100:00100000:0.0:1788970674.472808:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83568b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3652:1875871102396160:0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.473445:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788970674.473458:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102395648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970674.474282:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102395648:12345-0@lo:400:kworker.0 Request processed in 825us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970674.474292:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00100000:1.0:1788970674.474515:0:25034:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c393749-293e-4642-ade1-b2d863b30114 00000001:00100000:1.0:1788970674.474525:0:25034:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55e5d094-8e05-444c-a3e2-d2016031d5b4 00000001:00080000:1.0:1788970674.474531:0:25034:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1788970674.474650:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d8356a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102395648:0@lo:400:kworker.0 00000100:00100000:3.0:1788970674.474884:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102395008:0@lo:400:kworker.0 00010000:00010000:2.0:1788970675.293448:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970676.316594:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788970676.318377:0:25592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788970676.516822:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3c393749-293e-4642-ade1-b2d863b30114 00000001:00100000:2.0:1788970676.516835:0:23445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55e5d094-8e05-444c-a3e2-d2016031d5b4 00000001:00100000:2.0:1788970676.517260:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c393749-293e-4642-ade1-b2d863b30114 00000001:00100000:2.0:1788970676.517268:0:22691:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55e5d094-8e05-444c-a3e2-d2016031d5b4 00000001:00100000:0.0:1788970676.517681:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c393749-293e-4642-ade1-b2d863b30114 00000001:00100000:0.0:1788970676.517688:0:24215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55e5d094-8e05-444c-a3e2-d2016031d5b4 00010000:00010000:3.0:1788970677.340699:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970677.533711:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788970677.535164:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102396416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788970677.535423:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970677.535547:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396416 00000100:00100000:3.0:1788970677.535558:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396416 00000100:00100000:3.0:1788970677.535651:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788970677.535670:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102396416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788970677.535711:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788970677.535770:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102396416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970677.535777:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788970677.535853:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970677.536048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102396416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788970678.364485:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788970678.561768:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788970678.561790:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102396544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788970678.561870:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970678.562360:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396544 00000100:00100000:2.0:1788970678.562368:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396544 00000100:00100000:2.0:1788970678.562440:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970678.562448:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102396544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788970678.562468:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788970678.562511:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102396544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.562518:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788970678.562563:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102396544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788970678.562639:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970678.987480:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970678.987517:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970678.987545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970678.987563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970678.987591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970678.987616:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372736 00000100:00100000:0.0:1788970678.987626:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372736 00000100:00100000:0.0:1788970678.987683:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373248 00000100:00100000:0.0:1788970678.987686:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373248 00000100:00100000:0.0:1788970678.987707:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1788970678.987717:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2402:x1875871082372736:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970678.987799:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2402:x1875871082372736:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970678.987806:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:0.0:1788970678.987825:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:0.0:1788970678.987831:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+6:2402:x1875871082373248:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970678.987856:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+6:2402:x1875871082373248:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970678.987862:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00080000:1.0:1788970678.988068:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970678.991634:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372608 00000100:00100000:2.0:1788970678.991649:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372608 00000100:00100000:2.0:1788970678.991829:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:2.0:1788970678.991840:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:2403:x1875871082372608:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970678.991918:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:2403:x1875871082372608:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 79us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.991926:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 143 00000100:00100000:2.0:1788970678.991966:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372992 00000100:00100000:2.0:1788970678.991970:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372992 00000100:00100000:2.0:1788970678.992010:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373504 00000100:00100000:2.0:1788970678.992013:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373504 00000100:00100000:2.0:1788970678.992036:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970678.992043:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2402:x1875871082372992:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970678.992075:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2402:x1875871082372992:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 32us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.992081:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970678.992109:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:2.0:1788970678.992117:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2402:x1875871082373504:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970678.992145:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83568b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2402:x1875871082373504:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 30us (4553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.992151:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970678.992967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970678.993000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970678.993024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970678.993047:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970678.993072:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082372864 00000100:00100000:3.0:1788970678.993077:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082372864 00000100:00100000:3.0:1788970678.993253:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373376 00000100:00100000:3.0:1788970678.993258:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373376 00000100:00080000:2.0:1788970678.993338:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970678.993343:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788970678.993352:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373120 00000100:00100000:2.0:1788970678.993357:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373120 00000100:00100000:2.0:1788970678.993395:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373632 00000100:00100000:2.0:1788970678.993398:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373632 00000100:00100000:2.0:1788970678.993414:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970678.993421:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082373120:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970678.993463:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082373120:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 42us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.993469:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:2.0:1788970678.993483:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:2.0:1788970678.993489:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082373632:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:2.0:1788970678.993512:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082373632:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970678.993517:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00080000:2.0:1788970678.993532:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788970678.993852:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:1.0:1788970678.993863:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082372864:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970678.993908:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082372864:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 48us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970678.993915:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:1.0:1788970678.993931:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1788970678.993937:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082373376:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970678.993961:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082373376:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970678.993966:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1788970679.071497:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970679.071518:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102396672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970679.071583:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970679.071638:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102396800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970679.071658:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970679.071687:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396672 00000100:00100000:1.0:1788970679.071694:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396672 00000100:00100000:1.0:1788970679.071734:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102396800 00000100:00100000:1.0:1788970679.071737:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102396800 00000100:00100000:1.0:1788970679.071750:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970679.071757:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102396672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788970679.071791:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788970679.071830:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102396672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.071852:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788970679.071866:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970679.071871:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102396800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788970679.071885:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788970679.071911:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102396800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.071916:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788970679.071951:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102396800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970679.071975:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102396672:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788970679.141700:0:25740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefe01b7c0 20000000:00000080:1.0:1788970679.141715:0:25740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a7eb0ca2c00 uarg=0000000000000000 20000000:01000000:1.0:1788970679.141756:0:25740:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788970679.141762:0:25740:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788970679.141766:0:25740:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788970679.142345:0:25741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788970679.142621:0:25740:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788970679.152063:0:25740:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788970679.156212:0:25740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156304:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156325:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156332:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156339:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156348:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156354:0:25740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156361:0:25740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156426:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156442:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 12 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.156457:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e89a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102396928:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970679.156551:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156881:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.156901:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397056:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970679.156939:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.156947:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 23 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.156956:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397184:0@lo:104: 00000100:00100000:2.0:1788970679.156988:0:25740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970679.157018:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.157026:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.157034:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397312:0@lo:104: 00000100:00100000:2.0:1788970679.157048:0:25740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970679.157128:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.157136:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.157144:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397440:0@lo:104: 00000100:00100000:2.0:1788970679.157161:0:25740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788970679.159759:0:25740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.159800:0:25740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.159813:0:25740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397568:0@lo:104: 00000100:00100000:2.0:1788970679.159864:0:25740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.159885:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397184 00000100:00100000:0.0:1788970679.159894:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397184 00000100:00100000:0.0:1788970679.159935:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397312 00000100:00100000:0.0:1788970679.159938:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397312 00000100:00100000:0.0:1788970679.159947:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397440 00000100:00100000:0.0:1788970679.159949:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397440 00000100:00100000:0.0:1788970679.159961:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970679.159974:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:25740:x1875871102397184:12345-0@lo:104: 00010000:00010000:0.0:1788970679.159987:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.160083:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970679.160090:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+5:25740:x1875871102397184:12345-0@lo:104: Request processed in 116us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.160101:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788970679.160118:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970679.160124:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:25740:x1875871102397312:12345-0@lo:104: 00010000:00010000:0.0:1788970679.160131:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970679.160169:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970679.160505:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788970679.160514:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788970679.160518:0:25740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e88417b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788970679.160538:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e89a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102396928:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970679.160549:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397184:0@lo:104: 00000100:00100000:2.0:1788970679.160556:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397312:0@lo:104: 00010000:00010000:1.0:1788970679.160671:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788970679.160679:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160687:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9e00 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970679.160692:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160701:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970679.160723:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970679.160729:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788970679.160765:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160772:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788970679.160815:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3650:1875871102397696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970679.160845:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970679.160882:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160890:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9e00/0xc3abfebe76c70668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c7066f expref: -99 pid: 25033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160904:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788970679.160907:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160912:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed98600 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:1.0:1788970679.160915:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160922:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788970679.160928:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788970679.160933:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788970679.160953:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160958:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788970679.160973:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160980:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed98600/0xc3abfebe76c704e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704ee expref: -99 pid: 24214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.160989:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970679.160991:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970679.160993:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970679.161005:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102397824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788970679.161031:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788970679.161210:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970679.161297:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788970679.161306:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:25740:x1875871102397312:12345-0@lo:104: Request processed in 1181us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.161315:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788970679.161333:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397568 00000100:00100000:0.0:1788970679.161338:0:22694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397568 00000100:00100000:0.0:1788970679.161358:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970679.161364:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:25740:x1875871102397440:12345-0@lo:104: 00010000:00010000:0.0:1788970679.161372:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.161440:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788970679.161445:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+4:25740:x1875871102397440:12345-0@lo:104: Request processed in 82us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.161451:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788970679.161472:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.161478:0:22694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:25740:x1875871102397568:12345-0@lo:104: 00010000:00010000:0.0:1788970679.161486:0:22694:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.161517:0:22694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788970679.161521:0:22694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+3:25740:x1875871102397568:12345-0@lo:104: Request processed in 44us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.161527:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.161543:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373760 00000100:00100000:0.0:1788970679.161547:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373760 00000100:00100000:1.0:1788970679.161672:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397440:0@lo:104: 00000100:00100000:1.0:1788970679.161681:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397568:0@lo:104: 00010000:00010000:0.0:1788970679.161718:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970679.161772:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397696 00000100:00100000:0.0:1788970679.161776:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397696 00010000:00010000:0.0:1788970679.161788:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 24 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970679.161864:0:23467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397824 00000100:00100000:1.0:1788970679.161868:0:23467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397824 00010000:00010000:1.0:1788970679.161885:0:23467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 25 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970679.161901:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970679.161907:0:23467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:2402:x1875871082373760:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788970679.161918:0:23467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970679.161923:0:23467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.161944:0:23467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.161958:0:23467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655400/0xc3abfebe76c70813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ddda expref: 13 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.161970:0:23467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970679.162038:0:23467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:2402:x1875871082373760:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 132us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.162045:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:1.0:1788970679.162058:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970679.162064:0:23467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+25:3650:x1875871102397696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970679.162072:0:23467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970679.162075:0:23467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 25 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162082:0:23467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 25 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162092:0:23467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d83df3000/0xc3abfebe76c7066f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c70668 expref: 25 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162111:0:23467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970679.162434:0:23467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3650:x1875871102397696:12345-0@lo:103:ldlm_bl.0 Request processed in 368us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.162441:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788970679.162454:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970679.162460:0:23467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:3651:x1875871102397824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970679.162474:0:23467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970679.162478:0:23467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162487:0:23467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162496:0:23467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed98e00/0xc3abfebe76c704ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c704e7 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.162505:0:23467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970679.162530:0:23467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:3651:x1875871102397824:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.162536:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788970679.162645:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3651:1875871102397824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970679.162739:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788970679.162746:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162754:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b800 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970679.162758:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162766:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970679.162784:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970679.162790:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970679.162817:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162824:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970679.162838:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162845:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9b800/0xc3abfebe76c704a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704af expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162854:0:22699:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788970679.162857:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162862:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a000 already unused, calling callback (ffffffffc116cc20) 10000000:00010000:0.0:1788970679.162865:0:22699:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162872:0:22699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788970679.162878:0:22699:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788970679.162883:0:22699:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788970679.162899:0:22699:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162905:0:22699:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788970679.162915:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162921:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.115@tcp lock: ffff8a7eaed9a000/0xc3abfebe76c7049a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3abfebe76c704a1 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.162933:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970679.162935:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788970679.162936:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970679.162951:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102397952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970679.162983:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.163017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102398080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788970679.163038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.163058:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102397952 00000100:00100000:0.0:1788970679.163063:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102397952 00010000:00010000:0.0:1788970679.163079:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 22 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970679.163095:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398080 00000100:00100000:0.0:1788970679.163097:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398080 00010000:00010000:0.0:1788970679.163304:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970679.163321:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.163328:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:3652:x1875871102397952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970679.163336:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970679.163347:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970679.163376:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788970679.163404:0:23467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaecb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:3649:x1875871102398080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788970679.163412:0:23467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970679.163416:0:23467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.163458:0:23467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 23 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.163520:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.163531:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed99400/0xc3abfebe76c704af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c704a8 expref: 23 pid: 22704 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970679.163542:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970679.163589:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:3652:x1875871102397952:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.163596:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.163625:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3652:1875871102397952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788970679.163715:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788970679.163889:0:23467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7ec21f5400/0xc3abfebe76c704a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3abfebe76c7049a expref: 21 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.163900:0:23467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788970679.163974:0:23467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaecb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:3649:x1875871102398080:12345-0@lo:103:ldlm_bl.0 Request processed in 572us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970679.163981:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970679.164209:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102398080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788970679.164785:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3650:1875871102397696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788970679.164862:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970679.165273:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082373888 00000100:00100000:3.0:1788970679.165279:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082373888 00010000:00010000:3.0:1788970679.165304:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970679.165335:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:3.0:1788970679.165343:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:2403:x1875871082373888:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970679.165354:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970679.165360:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165407:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 12 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165423:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165431:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165446:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165453:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165459:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165465:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165471:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970679.165475:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165483:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165490:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970679.165510:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970679.165551:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:2403:x1875871082373888:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 208us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970679.165859:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00010000:00010000:2.0:1788970679.166488:0:25740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7eaed9ac00/0xc3abfebe76c707d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd6a expref: 11 pid: 22705 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970679.166503:0:25740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25740:1875871102397056:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970679.166535:0:25740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.166546:0:25740:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.166552:0:25740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970679.166625:0:25740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c70844 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970679.397642:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970679.581420:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102398208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970679.581494:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970679.581615:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398208 00000100:00100000:2.0:1788970679.581623:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398208 00000100:00100000:2.0:1788970679.581685:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788970679.581694:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102398208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788970679.581722:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970679.581765:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102398208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970679.581771:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788970679.581838:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970679.581871:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102398208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788970679.582684:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102398464:0@lo:400:kworker.0 00000100:00100000:1.0:1788970679.582699:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102398336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788970679.582734:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970679.582742:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.582804:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398336 00000100:00100000:0.0:1788970679.582810:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398336 00000100:00100000:0.0:1788970679.582850:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970679.582857:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102398336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970679.582872:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788970679.582906:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102398336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.582912:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788970679.582943:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398464 00000100:00100000:0.0:1788970679.582947:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398464 00000100:00100000:0.0:1788970679.582982:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.582989:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788970679.583056:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788970679.583075:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102398336:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788970679.583815:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788970679.583839:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102398720:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.583877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970679.583904:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102399232:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.583931:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970679.583950:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788970679.583955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.583973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970679.583991:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102399104:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.584009:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970679.584036:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399232 00000100:00100000:3.0:1788970679.584041:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399232 00000100:00100000:3.0:1788970679.584076:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398592 00000100:00100000:3.0:1788970679.584080:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398592 00000100:00100000:3.0:1788970679.584092:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399104 00000100:00100000:3.0:1788970679.584094:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399104 00000100:00100000:3.0:1788970679.584108:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788970679.584115:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102399232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.584165:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102399232:12345-0@lo:400:kworker.0 Request processed in 50us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970679.584172:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788970679.584717:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398720 00000100:00100000:2.0:1788970679.584723:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398720 00000100:00100000:2.0:1788970679.584749:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788970679.584754:0:24219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102398720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970679.584784:0:24219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102398720:12345-0@lo:400:kworker.0 Request processed in 31us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970679.584788:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788970679.585107:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875871102398464:12345-0@lo:400:kworker.0 Request processed in 2117us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.585115:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788970679.585140:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.585168:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.585193:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3652:1875871102398464:0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.585220:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788970679.585226:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102398848:0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.585244:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.585253:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102399360:0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.585266:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970679.585296:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398976 00000100:00100000:0.0:1788970679.585299:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398976 00000100:00100000:3.0:1788970679.585432:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970679.585445:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970679.585468:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788970679.585482:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102399104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.585491:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875871102398592:12345-0@lo:400:kworker.0 Request processed in 48us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970679.585498:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788970679.585515:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102398848 00000100:00100000:3.0:1788970679.585520:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102398848 00000100:00100000:2.0:1788970679.585525:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875871102399104:12345-0@lo:400:kworker.0 Request processed in 47us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970679.585533:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788970679.585544:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399360 00000100:00100000:3.0:1788970679.585549:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399360 00000100:00100000:2.0:1788970679.585552:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970679.585560:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102398848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.585578:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788970679.585585:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102399360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970679.585627:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102398848:12345-0@lo:400:kworker.0 Request processed in 68us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970679.585644:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102399360:12345-0@lo:400:kworker.0 Request processed in 56us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970679.585644:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788970679.585655:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788970679.585661:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788970679.585697:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102398848:0@lo:400:kworker.0 00010000:00080000:3.0:1788970679.585713:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d822d4f00 x1875871102399360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788970679.585723:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102399360:0@lo:400:kworker.0 00000100:00080000:3.0:1788970679.585786:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788970679.585792:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788970679.585797:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875871102398592:0@lo:400:kworker.0 00010000:00080000:2.0:1788970679.585810:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7d822d5a40 x1875871102399104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788970679.585819:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3650:1875871102399104:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.585964:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102398720:0@lo:400:kworker.0 00000100:00100000:3.0:1788970679.585979:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102399232:0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.587107:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788970679.587303:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970679.587409:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102398976:12345-0@lo:400:kworker.0 Request processed in 293us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970679.587417:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788970679.587493:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebba8d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102398976:0@lo:400:kworker.0 00010000:00010000:3.0:1788970680.412684:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970680.419364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.419527:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374016 00000100:00100000:2.0:1788970680.419548:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374016 00000100:00100000:2.0:1788970680.419630:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00100000:2.0:1788970680.419641:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:18713:x1875871082374016:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970680.419660:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.419683:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655800/0xc3abfebe76c7084b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de12 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419745:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419760:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419770:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419785:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419792:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419812:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419895:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c70860 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419904:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c70860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419910:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c70860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.419940:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970680.419944:0:25049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970680.419981:0:25049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c70860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419992:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.419999:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420006:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420012:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.420016:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420023:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420044:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:2.0:1788970680.420047:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.420052:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420058:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70852 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420073:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420079:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420084:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420089:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.420092:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420098:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420105:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a7d823e7000) 00010000:00010000:2.0:1788970680.420108:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.420111:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420116:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654000/0xc3abfebe76c70859 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420162:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655800/0xc3abfebe76c7084b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de12 expref: 8 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420177:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655000/0xc3abfebe76c70860 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de12 expref: 7 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.420184:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d823e7800) 00010000:00010000:2.0:1788970680.420186:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970680.420200:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655000, rc 0) 00000100:00100000:2.0:1788970680.426008:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18713:x1875871082374016:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 6355us (6639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.426023:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 23 00000100:00080000:0.0:1788970680.427275:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788970680.438977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.439152:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374144 00000100:00100000:2.0:1788970680.439163:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374144 00000100:00100000:2.0:1788970680.439291:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:2.0:1788970680.439303:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18713:x1875871082374144:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788970680.439422:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18713:x1875871082374144:12345-192.168.203.15@tcp:900:lhsmtool_posix.0 Request processed in 121us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.439430:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:2.0:1788970680.445259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.445419:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374400 00000100:00100000:3.0:1788970680.445429:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374400 00000100:00100000:3.0:1788970680.445593:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1788970680.445605:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18713:x1875871082374400:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970680.445626:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970680.445648:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c70867 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de19 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445720:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445734:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445746:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445760:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445767:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445774:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445911:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c7087c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445920:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c7087c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.445928:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c7087c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970680.445937:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788970680.446085:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446093:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446100:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446107:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970680.446111:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446119:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446130:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a7d823e7800) 00010000:00010000:3.0:1788970680.446133:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970680.446138:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446154:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3200/0xc3abfebe76c7086e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446168:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446175:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446180:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446185:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970680.446200:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446207:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446215:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a7d823ee100) 00010000:00010000:3.0:1788970680.446218:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970680.446221:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.446227:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2000/0xc3abfebe76c70875 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.447496:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c70867 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de19 expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.447532:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3c00/0xc3abfebe76c7087c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de19 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.447540:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823eec00) 00010000:00010000:3.0:1788970680.447542:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788970680.447545:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3c00, rc 0) 00000100:00100000:3.0:1788970680.447612:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18713:x1875871082374400:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 2009us (2363us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788970680.447621:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:3.0:1788970680.451270:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.451511:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374528 00000100:00100000:1.0:1788970680.451521:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374528 00000100:00100000:1.0:1788970680.451581:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:1.0:1788970680.451591:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18713:x1875871082374528:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788970680.451708:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18713:x1875871082374528:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 118us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.451716:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:1.0:1788970680.457472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.461074:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.461241:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374784 00000100:00100000:3.0:1788970680.461253:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374784 00000100:00100000:3.0:1788970680.461331:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:3.0:1788970680.461341:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:18713:x1875871082374784:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788970680.462044:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374656 00000100:00100000:2.0:1788970680.462052:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374656 00000100:00100000:2.0:1788970680.462110:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00100000:2.0:1788970680.462119:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+11:18095:x1875871082374656:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970680.462132:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.462159:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c7088a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de20 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.462186:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c7088a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de20 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.462211:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655800/0xc3abfebe76c7088a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de20 expref: 12 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.463016:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655800, rc 0) 00000100:00100000:2.0:1788970680.463099:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082374656:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 979us (5634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.463107:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 144 00000100:00080000:0.0:1788970680.466629:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788970680.466728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.466761:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082374912 00000100:00100000:0.0:1788970680.466771:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082374912 00000100:00100000:0.0:1788970680.466828:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 145 00000100:00100000:0.0:1788970680.466838:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082374912:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.466989:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082374912:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 151us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.466997:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 145 00000004:00080000:2.0:1788970680.467624:0:22712:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6164us 00000100:00100000:0.0:1788970680.485618:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.486976:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375040 00000100:00100000:2.0:1788970680.486990:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375040 00000100:00100000:2.0:1788970680.487169:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:2.0:1788970680.487181:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082375040:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.487339:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082375040:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 159us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.487347:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 146 00000100:00100000:2.0:1788970680.494367:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:18713:x1875871082374784:12345-192.168.203.15@tcp:59:lhsmtool_posix.0 Request processed in 33020us (33305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.494451:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 26 00000100:00100000:0.0:1788970680.497807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.497886:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.497916:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375296 00000100:00100000:0.0:1788970680.497926:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375296 00000100:00100000:0.0:1788970680.497979:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1788970680.497991:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18719:x1875871082375296:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970680.498012:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.498034:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c70891 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de2e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498093:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498107:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498118:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498151:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498158:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498197:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498457:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498465:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498471:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498476:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9000 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970680.498480:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498675:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498687:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:0.0:1788970680.498690:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970680.498695:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498701:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9000/0xc3abfebe76c70898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498715:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498721:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498734:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498739:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970680.498742:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498748:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498756:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d83360700) 00010000:00010000:0.0:1788970680.498759:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970680.498762:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498768:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9800/0xc3abfebe76c7089f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498804:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c70891 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de2e expref: 10 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498814:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:0.0:1788970680.498816:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970680.498819:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9200/0xc3abfebe76c70891 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de2e expref: 10 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.498828:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9200, rc 0) 00000100:00100000:0.0:1788970680.498894:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18719:x1875871082375296:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 905us (1007us total) trans 0 rc 301/301 00000100:00100000:0.0:1788970680.498910:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:3.0:1788970680.499055:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375168 00000100:00100000:3.0:1788970680.499061:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375168 00000100:00100000:3.0:1788970680.499101:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:3.0:1788970680.499109:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+12:18095:x1875871082375168:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970680.499117:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970680.499128:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c708a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de27 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.499146:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c708a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de27 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.499155:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d83df2000/0xc3abfebe76c708a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de27 expref: 13 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.499169:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2000, rc 0) 00000100:00100000:3.0:1788970680.499199:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18095:x1875871082375168:12345-192.168.203.15@tcp:101:ll_cfg_requeue.0 Request processed in 81us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970680.499206:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 147 00000100:00100000:0.0:1788970680.502371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.502488:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375424 00000100:00100000:2.0:1788970680.502497:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375424 00000100:00100000:2.0:1788970680.502537:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00100000:2.0:1788970680.502560:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18095:x1875871082375424:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.502745:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18095:x1875871082375424:12345-192.168.203.15@tcp:501:ll_cfg_requeue.0 Request processed in 186us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.502752:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 148 00000100:00100000:1.0:1788970680.505141:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.505362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.505514:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375552 00000100:00100000:2.0:1788970680.505524:0:22720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375552 00000100:00100000:2.0:1788970680.505573:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1788970680.505582:0:22720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18719:x1875871082375552:12345-192.168.203.15@tcp:700:lfs.0 00000100:00100000:0.0:1788970680.505960:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375680 00000100:00100000:0.0:1788970680.505966:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375680 00000100:00100000:0.0:1788970680.506041:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:0.0:1788970680.506050:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18095:x1875871082375680:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.507076:0:22720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18719:x1875871082375552:12345-192.168.203.15@tcp:700:lfs.0 Request processed in 1489us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.507087:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970680.507247:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eaae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:18095:x1875871082375680:12345-192.168.203.15@tcp:503:ll_cfg_requeue.0 Request processed in 1196us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.507256:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 149 00000100:00100000:1.0:1788970680.517670:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.517739:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082375936 00000100:00100000:3.0:1788970680.517749:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082375936 00000100:00100000:3.0:1788970680.517811:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:3.0:1788970680.517820:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:18719:x1875871082375936:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:3.0:1788970680.517874:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970680.517900:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c707fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dd9b expref: 9 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.517917:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:3.0:1788970680.517922:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788970680.517981:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.517992:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 5 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.517998:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.518022:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 5 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.518031:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 5 pid: 25049 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.518056:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1875871102399488:192.168.203.15@tcp:104: 00000100:00100000:3.0:1788970680.518128:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788970680.522595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.522708:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1875871102399488:192.168.203.15@tcp:104: 00010000:00010000:1.0:1788970680.522743:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970680.522843:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376064 00000100:00100000:0.0:1788970680.522850:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376064 00010000:00010000:0.0:1788970680.522900:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 6 pid: 25049 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970680.522941:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970680.522951:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c393749-293e-4642-ade1-b2d863b30114+6:2402:x1875871082376064:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970680.522965:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970680.522972:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 6 pid: 25049 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.522984:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 6 pid: 25049 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.523004:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c7083d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de0b expref: 6 pid: 25049 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.523037:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:0.0:1788970680.523042:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.523050:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.523056:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.523085:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970680.523130:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c393749-293e-4642-ade1-b2d863b30114+5:2402:x1875871082376064:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 180us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.523138:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00010000:00010000:2.0:1788970680.523203:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.523211:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.523233:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.523242:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.523249:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788970680.523772:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788970680.524765:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524792:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524801:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970680.524818:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c94bd9d8 reply state 00000000670d0479 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524827:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524834:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:2.0:1788970680.524837:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970680.524840:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788970680.524845:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788970680.524852:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524859:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524865:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524871:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df2a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.524875:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524881:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524899:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7eb55b4a00) 00010000:00010000:2.0:1788970680.524901:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.524906:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524912:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2a00/0xc3abfebe76c708ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970680.524928:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c94bd9d8 reply state 00000000670d0479 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524935:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.524940:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d823e7200) 00010000:00010000:2.0:1788970680.524943:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970680.524944:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788970680.525027:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ea1f2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+10:18719:x1875871082375936:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 7205us (7361us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788970680.525036:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 10000000:01000000:0.0:1788970680.540835:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788970680.540843:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7ebf3b2800 from 13 10000000:01000000:0.0:1788970680.540848:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788970680.540894:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.540904:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.540914:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970680.540937:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.541013:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970680.541054:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37480 going to sleep for 11 seconds 00000100:00100000:2.0:1788970680.541123:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399616 00000100:00100000:2.0:1788970680.541131:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399616 00000100:00100000:2.0:1788970680.541186:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788970680.541205:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+20:22708:x1875871102399616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970680.541217:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.541228:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82655e00/0xc3abfebe76c708c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c708c2 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.541249:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82655e00/0xc3abfebe76c708c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c708c2 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.541268:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82655e00/0xc3abfebe76c708c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c708c2 expref: 21 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.541276:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655e00, rc 0) 00000100:00100000:2.0:1788970680.541333:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102399616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.541339:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788970680.541454:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970680.541468:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708c9 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.541477:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c708c9 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970680.541537:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.541565:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.541591:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399744 00000100:00100000:3.0:1788970680.541597:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399744 00000100:00100000:0.0:1788970680.541598:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970680.541638:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788970680.541647:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102399744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.541775:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102399744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970680.541782:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788970680.541917:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.541965:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.542013:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970680.542035:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e82c37480 going to sleep for 11 seconds 00000100:00100000:1.0:1788970680.542076:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102399872 00000100:00100000:1.0:1788970680.542081:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102399872 00000100:00100000:1.0:1788970680.542115:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788970680.542122:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102399872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788970680.542223:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102399872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.542231:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788970680.542633:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102399872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788970680.546163:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788970680.550429:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788970680.550470:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970680.550482:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708c9 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.550494:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7eb59a9200/0xc3abfebe76c708c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708c9 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788970680.550621:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788970680.550625:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d82193800 from 13 10000000:01000000:2.0:1788970680.550628:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788970680.550741:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.550751:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.550763:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970680.550891:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.550953:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970680.550996:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea76899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788970680.554871:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400000 00000100:00100000:0.0:1788970680.554885:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400000 00000100:00100000:0.0:1788970680.555173:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788970680.555184:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+21:22708:x1875871102400000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970680.555211:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.555229:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c708d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c708d0 expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.555256:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c708d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c708d0 expref: 22 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.555297:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9800/0xc3abfebe76c708d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c708d0 expref: 22 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.555307:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9800, rc 0) 00000100:00100000:0.0:1788970680.555420:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (4466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.555426:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788970680.555534:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970680.555553:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708d7 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.555561:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c708d7 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970680.555640:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.555677:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970680.561724:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea76899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788970680.562497:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400128 00000100:00100000:3.0:1788970680.562508:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400128 00000100:00100000:1.0:1788970680.566301:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788970680.566323:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970680.566500:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (10821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.566507:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788970680.566694:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.566887:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.567002:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.567038:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970680.568711:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400256 00000100:00100000:2.0:1788970680.568724:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400256 00000100:00100000:2.0:1788970680.568769:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788970680.568790:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788970680.568949:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.568958:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788970680.569235:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788970680.578834:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788970680.580877:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788970680.580917:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970680.580929:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708d7 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.580942:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d82654c00/0xc3abfebe76c708d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708d7 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970680.580954:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970680.580956:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d81a76800 from 13 10000000:01000000:3.0:1788970680.580959:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970680.580997:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.581006:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.581016:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.581041:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.581104:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.581185:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788970680.581611:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400384 00000100:00100000:2.0:1788970680.581619:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400384 00000100:00100000:2.0:1788970680.581658:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788970680.581667:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+22:22708:x1875871102400384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788970680.581680:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.581693:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c708e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c708de expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.581715:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c708e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c708de expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.581726:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7d82654000/0xc3abfebe76c708e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c708de expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.581734:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654000, rc 0) 00000100:00100000:2.0:1788970680.581798:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.581805:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788970680.581926:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970680.581941:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708e5 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.581949:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c708e5 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.582025:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.582053:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.582086:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788970680.582151:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400512 00000100:00100000:1.0:1788970680.582156:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400512 00000100:00100000:1.0:1788970680.582187:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788970680.582203:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788970680.582309:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.582316:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788970680.582400:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.582430:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.582464:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.582485:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970680.582540:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400640 00000100:00100000:0.0:1788970680.582544:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400640 00000100:00100000:0.0:1788970680.582576:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788970680.582583:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.582667:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.582673:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788970680.582781:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970680.583580:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788970680.583760:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788970680.583780:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788970680.583788:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708e5 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.583798:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df3200/0xc3abfebe76c708de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708e5 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788970680.583807:0:22708:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788970680.583809:0:22708:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a7d827a9000 from 13 10000000:01000000:3.0:1788970680.583812:0:22708:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788970680.583838:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.583845:0:22708:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.583854:0:22708:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.583880:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.583918:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.583949:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970680.583998:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400768 00000100:00100000:0.0:1788970680.584005:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400768 00000100:00100000:0.0:1788970680.584040:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788970680.584048:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+23:22708:x1875871102400768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788970680.584058:0:22703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.584068:0:22703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a7eb59a9000/0xc3abfebe76c708f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3abfebe76c708ec expref: -99 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.584087:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a7eb59a9000/0xc3abfebe76c708f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3abfebe76c708ec expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.584096:0:22703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a7eb59a9000/0xc3abfebe76c708f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3abfebe76c708ec expref: 24 pid: 22703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.584115:0:22703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9000, rc 0) 00000100:00100000:0.0:1788970680.584156:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102400768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.584163:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788970680.584312:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788970680.584325:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708f3 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.584334:0:22708:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3abfebe76c708f3 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.584413:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.584447:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.584463:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970680.584520:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102400896 00000100:00100000:0.0:1788970680.584525:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102400896 00000100:00100000:0.0:1788970680.584554:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788970680.584560:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102400896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.584649:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102400896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.584655:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788970680.584728:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102400896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.584756:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102401024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788970680.585003:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970680.585163:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eaecb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788970680.585728:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102401024 00000100:00100000:0.0:1788970680.585736:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102401024 00000100:00100000:0.0:1788970680.585816:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788970680.585825:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102401024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788970680.585971:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:22708:x1875871102401024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.585978:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788970680.587255:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d822d4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:22708:1875871102401024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788970680.588902:0:25758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788970680.589104:0:22708:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788970680.589132:0:22708:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788970680.589143:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708f3 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.589155:0:22708:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.115@tcp lock: ffff8a7d83df2600/0xc3abfebe76c708ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3abfebe76c708f3 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970680.603975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.604051:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376192 00000100:00100000:0.0:1788970680.604062:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376192 00000100:00100000:0.0:1788970680.604119:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:0.0:1788970680.604130:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+10:18729:x1875871082376192:12345-192.168.203.15@tcp:101:lctl.0 00010000:00010000:0.0:1788970680.604153:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.604173:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c708fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de35 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604269:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9e00/0xc3abfebe76c70901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604282:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9e00/0xc3abfebe76c70901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604293:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9e00/0xc3abfebe76c70901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970680.604538:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788970680.604543:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970680.604662:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9e00/0xc3abfebe76c70901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604689:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9a00/0xc3abfebe76c708fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de35 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604706:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9e00/0xc3abfebe76c70901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de35 expref: 11 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.604714:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:0.0:1788970680.604717:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788970680.604721:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9e00, rc 0) 00000100:00100000:0.0:1788970680.604876:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+11:18729:x1875871082376192:12345-192.168.203.15@tcp:101:lctl.0 Request processed in 747us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.604884:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:1.0:1788970680.627143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.627251:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376320 00000100:00100000:2.0:1788970680.627263:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376320 00000100:00100000:2.0:1788970680.627335:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1788970680.627347:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+5:18730:x1875871082376320:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970680.627369:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.627425:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c70908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de3c expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627491:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c7090f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627504:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c7090f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627514:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c7090f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.627585:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970680.627590:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970680.627610:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c7090f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627634:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c70908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de3c expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627653:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655400/0xc3abfebe76c7090f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de3c expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.627660:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.627663:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970680.627667:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655400, rc 0) 00000100:00100000:2.0:1788970680.627741:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+6:18730:x1875871082376320:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 397us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.627748:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:1.0:1788970680.635507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.635674:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376448 00000100:00100000:2.0:1788970680.635685:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376448 00000100:00100000:2.0:1788970680.635799:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:2.0:1788970680.635812:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c393749-293e-4642-ade1-b2d863b30114+6:18730:x1875871082376448:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970680.635832:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.635852:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c70916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de43 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635917:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635947:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635958:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635970:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635976:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.635982:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636052:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636060:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636067:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.636105:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970680.636109:0:25049:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970680.636127:0:25049:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636150:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636166:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636762:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636769:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.636774:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636782:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636794:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.636797:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.636802:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636808:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c7091d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636824:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636830:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636837:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636841:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.636852:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636858:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636865:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d823e7200) 00010000:00010000:2.0:1788970680.636867:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.636870:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636875:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636905:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654a00/0xc3abfebe76c70916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de43 expref: 8 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636919:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de43 expref: 7 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.636926:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:2.0:1788970680.636928:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788970680.636930:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654600, rc 0) 00000100:00100000:2.0:1788970680.637049:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c393749-293e-4642-ade1-b2d863b30114+7:18730:x1875871082376448:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 1238us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.637056:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 31 00000100:00100000:3.0:1788970680.647011:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.649937:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376576 00000100:00100000:1.0:1788970680.649953:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376576 00000100:00100000:1.0:1788970680.650040:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:1.0:1788970680.650052:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c393749-293e-4642-ade1-b2d863b30114+5:18730:x1875871082376576:12345-192.168.203.15@tcp:900:lfs.0 00000100:00100000:1.0:1788970680.650159:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3c393749-293e-4642-ade1-b2d863b30114+5:18730:x1875871082376576:12345-192.168.203.15@tcp:900:lfs.0 Request processed in 109us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.650184:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00080000:3.0:1788970680.650315:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788970680.656901:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.657072:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082376832 00000100:00100000:2.0:1788970680.657081:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082376832 00000100:00100000:2.0:1788970680.657156:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:2.0:1788970680.657166:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+7:18730:x1875871082376832:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970680.657211:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.657231:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de4a expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.657334:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788970680.657486:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de4a expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.657501:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.657505:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970680.657510:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de4a expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.657524:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:2.0:1788970680.657577:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+8:18730:x1875871082376832:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 412us (687us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788970680.657583:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 32 00000100:00100000:2.0:1788970680.663185:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.663420:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082377088 00000100:00100000:1.0:1788970680.663431:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082377088 00000100:00100000:1.0:1788970680.663482:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:1.0:1788970680.663491:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+8:18730:x1875871082377088:12345-192.168.203.15@tcp:36:lfs.0 00010000:00010000:1.0:1788970680.663540:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970680.663563:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c7092b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de43 expref: 8 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.663584:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:1.0:1788970680.663589:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970680.663611:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.663625:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.663634:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788970680.663826:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8e7b193 reply state 00000000f4bf533d transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.663840:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.663847:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:1.0:1788970680.663850:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788970680.663866:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788970680.663874:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788970680.663948:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+9:18730:x1875871082377088:12345-192.168.203.15@tcp:36:lfs.0 Request processed in 458us (772us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788970680.663956:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 33 00000100:00100000:0.0:1788970680.666878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.667012:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082377344 00000100:00100000:3.0:1788970680.667022:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082377344 00000100:00100000:3.0:1788970680.667078:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970680.667088:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+9:18730:x1875871082377344:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970680.667368:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+10:18730:x1875871082377344:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 281us (498us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788970680.667376:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970680.671883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.672034:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082377600 00000100:00100000:2.0:1788970680.672044:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082377600 00000100:00100000:2.0:1788970680.672097:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:2.0:1788970680.672106:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+10:18730:x1875871082377600:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970680.672128:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.672158:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de51 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672234:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672260:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672273:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672285:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672293:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672300:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.672436:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788970680.672510:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672518:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672525:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672531:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.672535:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672542:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672575:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.672579:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.672585:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672591:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c7094e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672606:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672611:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672616:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672621:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654e00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.672624:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672628:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672635:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d823e7200) 00010000:00010000:2.0:1788970680.672637:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.672640:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672645:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70955 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672688:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70947 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de51 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672698:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.672700:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970680.672703:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de51 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.672711:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:2.0:1788970680.672771:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c393749-293e-4642-ade1-b2d863b30114+11:18730:x1875871082377600:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 665us (897us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788970680.672778:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 34 00000100:00100000:2.0:1788970680.676536:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970680.678328:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082377728 00000100:00100000:1.0:1788970680.678342:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082377728 00000100:00100000:1.0:1788970680.678436:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:1.0:1788970680.678448:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+11:18730:x1875871082377728:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:1.0:1788970680.678539:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970680.678562:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70963 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de58 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.678807:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.678821:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.678833:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970680.678855:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788970680.678859:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970680.680445:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.680503:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70963 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 13 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.680526:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.680550:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:1.0:1788970680.680554:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788970680.680557:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b400, rc 0) 00000100:00100000:1.0:1788970680.680701:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c393749-293e-4642-ade1-b2d863b30114+12:18730:x1875871082377728:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 2253us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.680710:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 35 00000100:00100000:0.0:1788970680.688580:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.688655:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082377856 00000100:00100000:3.0:1788970680.688666:0:22714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082377856 00000100:00100000:3.0:1788970680.688721:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:3.0:1788970680.688731:0:22714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c393749-293e-4642-ade1-b2d863b30114+12:18730:x1875871082377856:12345-192.168.203.15@tcp:37:lfs.0 00000100:00100000:0.0:1788970680.699063:0:22714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c393749-293e-4642-ade1-b2d863b30114+12:18730:x1875871082377856:12345-192.168.203.15@tcp:37:lfs.0 Request processed in 10323us (10483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.699077:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 3 00000100:00100000:2.0:1788970680.706701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.706812:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378112 00000100:00100000:0.0:1788970680.706823:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378112 00000100:00100000:0.0:1788970680.706921:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 4 00000100:00100000:0.0:1788970680.706932:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+12:18730:x1875871082378112:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970680.707184:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef92450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c393749-293e-4642-ade1-b2d863b30114+13:18730:x1875871082378112:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 246us (485us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788970680.707200:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 4 00000040:00080000:1.0:1788970680.732980:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788970680.770426:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.770961:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378240 00000100:00100000:2.0:1788970680.770971:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378240 00000100:00100000:2.0:1788970680.771030:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:2.0:1788970680.771040:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+11:18736:x1875871082378240:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:2.0:1788970680.771059:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.771076:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de5f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771139:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771153:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771182:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771204:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771211:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771219:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771290:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70986 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771299:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70986 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771305:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70986 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.771337:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788970680.771340:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788970680.771375:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70986 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771411:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771418:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771441:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771446:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82655200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.771451:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771458:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771469:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:2.0:1788970680.771472:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.771477:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771482:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771496:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771502:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771507:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771512:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970680.771514:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771531:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771539:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d823e7200) 00010000:00010000:2.0:1788970680.771541:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970680.771544:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771551:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c7097f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771576:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de5f expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771590:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655a00/0xc3abfebe76c70986 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de5f expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.771599:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:2.0:1788970680.771601:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788970680.771604:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655a00, rc 0) 00000100:00100000:2.0:1788970680.771803:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+12:18736:x1875871082378240:12345-192.168.203.15@tcp:101:bash.0 Request processed in 764us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.771818:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 36 00000100:00100000:1.0:1788970680.774077:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.774226:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378368 00000100:00100000:2.0:1788970680.774235:0:22723:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378368 00000100:00100000:2.0:1788970680.774291:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:2.0:1788970680.774301:0:22723:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:18736:x1875871082378368:12345-192.168.203.15@tcp:900:bash.0 00000100:00100000:2.0:1788970680.774468:0:22723:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:18736:x1875871082378368:12345-192.168.203.15@tcp:900:bash.0 Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.774476:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970680.776535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.776822:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378624 00000100:00100000:0.0:1788970680.776833:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378624 00000100:00100000:0.0:1788970680.777586:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:0.0:1788970680.777600:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+12:18736:x1875871082378624:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:0.0:1788970680.777621:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.777641:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c7098d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de66 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.777746:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.777763:0:25049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.777772:0:25049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.777804:0:25049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 12 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.777832:0:25049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 12 pid: 22713 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970680.777845:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401152:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970680.777944:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788970680.780587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.780618:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401152:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970680.780645:0:25049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970680.780672:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378752 00000100:00100000:2.0:1788970680.780680:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378752 00010000:00010000:2.0:1788970680.780709:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 13 pid: 22713 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970680.780743:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:2.0:1788970680.780752:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c393749-293e-4642-ade1-b2d863b30114+13:2403:x1875871082378752:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970680.780765:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970680.780771:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 13 pid: 22713 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780782:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 13 pid: 22713 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780802:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b400/0xc3abfebe76c7096a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de58 expref: 13 pid: 22713 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780817:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:2.0:1788970680.780822:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780832:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780840:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.780880:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970680.780930:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c393749-293e-4642-ade1-b2d863b30114+12:2403:x1875871082378752:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970680.780938:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00010000:00010000:0.0:1788970680.781413:0:25049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781422:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781482:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781493:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781501:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781917:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781926:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.781944:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970680.781956:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788970680.782324:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782334:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782340:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782346:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970680.782351:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782357:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782368:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:0.0:1788970680.782371:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970680.782375:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782504:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70994 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788970680.782517:0:25049:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058557d91 reply state 000000007154c849 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782542:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782548:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a7d83360400) 00010000:00010000:0.0:1788970680.782551:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788970680.782554:0:25049:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788970680.782594:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c7098d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 15 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782609:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 14 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.782616:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970680.782618:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788970680.782620:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8800, rc 0) 00000100:00100000:0.0:1788970680.782709:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+15:18736:x1875871082378624:12345-192.168.203.15@tcp:101:bash.0 Request processed in 5112us (6184us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788970680.782717:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 37 00000100:00100000:1.0:1788970680.795138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.795232:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082378880 00000100:00100000:3.0:1788970680.795242:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082378880 00000100:00100000:3.0:1788970680.795295:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1788970680.795305:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+15:18736:x1875871082378880:12345-192.168.203.15@tcp:101:bash.0 00010000:00010000:3.0:1788970680.795328:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970680.795346:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c709b0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de6d expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795465:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795478:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795489:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970680.795534:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788970680.795545:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788970680.795569:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795579:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795603:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c709b0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 17 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795621:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970680.795629:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970680.795632:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788970680.795636:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df2c00, rc 0) 00000100:00100000:3.0:1788970680.795695:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:18736:x1875871082378880:12345-192.168.203.15@tcp:101:bash.0 Request processed in 392us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970680.795703:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 38 00000100:00100000:3.0:1788970680.801044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.801212:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082379136 00000100:00100000:0.0:1788970680.801221:0:22714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082379136 00000100:00100000:0.0:1788970680.801279:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:0.0:1788970680.801289:0:22714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:18736:x1875871082379136:12345-192.168.203.15@tcp:35:bash.0 00000100:00100000:0.0:1788970680.801580:0:22714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+17:18736:x1875871082379136:12345-192.168.203.15@tcp:35:bash.0 Request processed in 292us (548us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788970680.801588:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 5 00000100:00100000:1.0:1788970680.893755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.893943:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082379392 00000100:00100000:0.0:1788970680.893967:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082379392 00000100:00100000:0.0:1788970680.894031:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:0.0:1788970680.894042:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+17:18746:x1875871082379392:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:0.0:1788970680.894065:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970680.894084:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c709be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de74 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970680.894215:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788970680.894312:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c709be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de74 expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.894325:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a7d83360000) 00010000:00010000:0.0:1788970680.894328:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788970680.894334:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c709be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de74 expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.894348:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8400, rc 0) 00000100:00100000:0.0:1788970680.894463:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+18:18746:x1875871082379392:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 423us (716us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788970680.894471:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 39 00000100:00100000:1.0:1788970680.898478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.898590:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082379648 00000100:00100000:0.0:1788970680.898600:0:22714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082379648 00000100:00100000:0.0:1788970680.898654:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:0.0:1788970680.898664:0:22714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+18:18746:x1875871082379648:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:0.0:1788970680.898881:0:22714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+19:18746:x1875871082379648:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 219us (410us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788970680.898889:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 6 00000100:00100000:3.0:1788970680.938213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970680.938557:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082379904 00000100:00100000:2.0:1788970680.938568:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082379904 00000100:00100000:2.0:1788970680.938688:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:2.0:1788970680.938700:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+19:18749:x1875871082379904:12345-192.168.203.15@tcp:101:lfs.0 00010000:00010000:2.0:1788970680.938736:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970680.938758:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c709cc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de7b expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.938876:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c709d3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.938894:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c709d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.938907:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c709d3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970680.938917:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970680.939011:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c709cc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de7b expref: 22 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.939028:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c709d3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de7b expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970680.939056:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:2.0:1788970680.939059:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970680.939063:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:2.0:1788970680.939342:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+21:18749:x1875871082379904:12345-192.168.203.15@tcp:101:lfs.0 Request processed in 644us (1138us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788970680.939350:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 40 00000100:00100000:0.0:1788970680.942461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.943427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970680.943454:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082380160 00000100:00100000:0.0:1788970680.943464:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082380160 00000100:00100000:0.0:1788970680.943527:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970680.943537:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+21:2402:x1875871082380160:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970680.943551:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970680.943575:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c709d3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de7b expref: 21 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970680.943594:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970680.943598:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970680.943646:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:2402:x1875871082380160:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970680.943653:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:1.0:1788970680.945056:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082380032 00000100:00100000:1.0:1788970680.945069:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082380032 00000100:00100000:1.0:1788970680.945286:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1788970680.945297:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18749:x1875871082380032:12345-192.168.203.15@tcp:54:lfs.0 00010000:00010000:1.0:1788970680.945362:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945377:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945410:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945444:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945469:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945477:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945483:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9ac00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970680.945488:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945495:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945508:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:1.0:1788970680.945511:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788970680.945516:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970680.945522:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970680.945586:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18749:x1875871082380032:12345-192.168.203.15@tcp:54:lfs.0 Request processed in 291us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970680.945593:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 41 00000100:00100000:1.0:1788970680.948455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970680.948576:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082380416 00000100:00100000:3.0:1788970680.948587:0:22714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082380416 00000100:00100000:3.0:1788970680.948652:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 7 00000100:00100000:3.0:1788970680.948664:0:22714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18749:x1875871082380416:12345-192.168.203.15@tcp:35:lfs.0 00000100:00100000:3.0:1788970680.949031:0:22714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+21:18749:x1875871082380416:12345-192.168.203.15@tcp:35:lfs.0 Request processed in 368us (584us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788970680.949038:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 7 00000040:00080000:0.0:1788970680.989046:0:23466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788970681.236964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.238526:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082380672 00000100:00100000:1.0:1788970681.238543:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082380672 00000100:00100000:1.0:1788970681.238695:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1788970681.238707:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+21:18780:x1875871082380672:12345-192.168.203.15@tcp:101:cat.0 00010000:00010000:1.0:1788970681.238750:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970681.238770:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de82 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.239073:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c709ef lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.239091:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c709ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.239103:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c709ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970681.239114:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788970681.239457:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ac00/0xc3abfebe76c709e8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de82 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.239475:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c709ef lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de82 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.239483:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:1.0:1788970681.239486:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788970681.239489:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9b800, rc 0) 00000100:00100000:1.0:1788970681.239567:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:18780:x1875871082380672:12345-192.168.203.15@tcp:101:cat.0 Request processed in 862us (2613us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788970681.239574:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 42 00000100:00100000:1.0:1788970681.245485:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.245612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.245925:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381056 00000100:00100000:3.0:1788970681.245942:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381056 00000100:00100000:3.0:1788970681.246027:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:2.0:1788970681.246029:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082380800 00000100:00100000:3.0:1788970681.246043:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:18780:x1875871082381056:12345-192.168.203.15@tcp:35:cat.0 00000100:00100000:2.0:1788970681.246077:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082380800 00000100:00100000:2.0:1788970681.246199:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1788970681.246210:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+24:2401:x1875871082380800:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970681.246227:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970681.246251:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c709ef lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de82 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.246272:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:2.0:1788970681.246277:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970681.246340:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:2401:x1875871082380800:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 132us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.246348:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:3.0:1788970681.248100:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:18780:x1875871082381056:12345-192.168.203.15@tcp:35:cat.0 Request processed in 2047us (2472us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788970681.248115:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 8 00000100:00100000:0.0:1788970681.338986:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.339098:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381312 00000100:00100000:2.0:1788970681.339114:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381312 00000100:00100000:2.0:1788970681.339201:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:2.0:1788970681.339212:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:18786:x1875871082381312:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:2.0:1788970681.339237:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970681.339259:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c709fd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de89 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.339855:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.339874:0:25049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 24 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.339883:0:25049:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.340664:0:25049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.340717:0:25049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.340734:0:25049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 24 pid: 22712 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.340750:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401280:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970681.340852:0:25049:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 24 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.340861:0:25049:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 24 pid: 25049 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.340870:0:25049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401408:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970681.341130:0:25049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788970681.345675:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401280:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970681.345698:0:25049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d83e8a940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25049:1875871102401408:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970681.345705:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00010000:00010000:2.0:1788970681.345730:0:25049:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970681.345845:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.352334:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381440 00000100:00100000:0.0:1788970681.352358:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381440 00010000:00010000:0.0:1788970681.352457:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 25 pid: 22712 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970681.352522:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381568 00000100:00100000:0.0:1788970681.352527:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381568 00010000:00010000:0.0:1788970681.352543:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 26 pid: 25049 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970681.352582:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970681.352612:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+26:2403:x1875871082381440:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970681.352631:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970681.352639:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 26 pid: 22712 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.352655:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 26 pid: 22712 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.352683:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2c00/0xc3abfebe76c709b7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de6d expref: 26 pid: 22712 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.352706:0:22696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970681.352712:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.352723:0:22696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.352731:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970681.352816:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+25:2403:x1875871082381440:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 207us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970681.352824:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:3.0:1788970681.353028:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 18 00000100:00100000:3.0:1788970681.353040:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaecb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+25:2403:x1875871082381568:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970681.353050:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970681.353057:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 25 pid: 25049 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353068:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 25 pid: 25049 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353093:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8800/0xc3abfebe76c709a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de66 expref: 25 pid: 25049 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353106:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970681.353110:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353120:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353129:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353166:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970681.353201:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaecb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+24:2403:x1875871082381568:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 164us (7357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.353207:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 18 00010000:00010000:3.0:1788970681.353263:0:25049:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353272:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788970681.353295:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788970681.353527:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c709fd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de89 expref: 25 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353546:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82655200/0xc3abfebe76c70a04 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de89 expref: 24 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.353555:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970681.353557:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788970681.353560:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82655200, rc 0) 00000100:00100000:3.0:1788970681.353587:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+24:18786:x1875871082381312:12345-192.168.203.15@tcp:101:dd.0 Request processed in 14378us (14617us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788970681.353595:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 43 00000100:00100000:0.0:1788970681.356491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.356581:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381696 00000100:00100000:1.0:1788970681.356594:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381696 00000100:00100000:1.0:1788970681.356661:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1788970681.356672:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+23:18786:x1875871082381696:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1788970681.356703:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970681.356728:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a12 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de90 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.356771:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.356789:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.356802:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.356969:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a12 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 25 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.356992:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 24 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.357001:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:1.0:1788970681.357004:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788970681.357008:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9ba00, rc 0) 00000100:00100000:1.0:1788970681.357087:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+24:18786:x1875871082381696:12345-192.168.203.15@tcp:101:dd.0 Request processed in 416us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970681.357106:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 44 00000100:00100000:1.0:1788970681.363927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.364159:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082381952 00000100:00100000:3.0:1788970681.364173:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082381952 00000100:00100000:3.0:1788970681.364262:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 45 00000100:00100000:3.0:1788970681.364276:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+24:18786:x1875871082381952:12345-192.168.203.15@tcp:36:dd.0 00010000:00010000:3.0:1788970681.364640:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.364663:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.364677:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788970681.364739:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788970681.364765:0:22712:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e50a8fef reply state 0000000075fcf8ed transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.364781:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.364789:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970681.364793:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788970681.364798:0:22712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788970681.364916:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082381952:12345-192.168.203.15@tcp:36:dd.0 Request processed in 641us (1001us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788970681.364925:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 45 00000020:00080000:3.0:1788970681.364932:0:22712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788970681.375214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.375323:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382080 00000100:00100000:1.0:1788970681.375336:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382080 00000100:00100000:1.0:1788970681.375456:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:1.0:1788970681.375470:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082382080:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:1.0:1788970681.375501:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970681.375529:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a27 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de97 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.375607:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de97 expref: 28 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.375625:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a27 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de97 expref: 28 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.375649:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:1.0:1788970681.375653:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788970681.375657:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9be00, rc 0) 00000100:00100000:1.0:1788970681.376000:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18786:x1875871082382080:12345-192.168.203.15@tcp:101:dd.0 Request processed in 532us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970681.376008:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1788970681.415368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.415500:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382336 00000100:00100000:3.0:1788970681.415513:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382336 00000100:00100000:3.0:1788970681.415584:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:3.0:1788970681.415596:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18786:x1875871082382336:12345-192.168.203.15@tcp:103:dd.0 00010000:00010000:3.0:1788970681.415621:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970681.415654:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a27 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de97 expref: 28 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.415699:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970681.415706:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970681.415779:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082382336:12345-192.168.203.15@tcp:103:dd.0 Request processed in 184us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.415788:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 2 00000100:00100000:2.0:1788970681.419284:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.419421:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382464 00000100:00100000:3.0:1788970681.419435:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382464 00000100:00100000:3.0:1788970681.419510:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:3.0:1788970681.419521:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082382464:12345-192.168.203.15@tcp:58:dd.0 00010000:00010000:3.0:1788970681.419661:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.419684:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.419698:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788970681.421136:0:22712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788970681.421179:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788970681.421453:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788970681.421648:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082382464:12345-192.168.203.15@tcp:58:dd.0 Request processed in 2120us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.421662:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1788970681.434318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.434478:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382592 00000100:00100000:3.0:1788970681.434492:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382592 00000100:00100000:3.0:1788970681.434570:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:3.0:1788970681.434582:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+27:18786:x1875871082382592:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:3.0:1788970681.434630:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970681.434658:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8de9e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434743:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434758:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434782:0:22711:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434799:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434816:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:3.0:1788970681.434820:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788970681.434825:0:22711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 28 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.434846:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d83df3e00, rc 0) 00000100:00100000:3.0:1788970681.435167:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18786:x1875871082382592:12345-192.168.203.15@tcp:101:dd.0 Request processed in 585us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.435176:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00010000:00010000:0.0:1788970681.437492:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788970681.756688:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788970681.756705:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788970681.756749:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788970681.756764:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788970681.756993:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e5f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22745:1875871102401536:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788970681.757495:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8448b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788970681.770797:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.771821:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382720 00000100:00100000:2.0:1788970681.771837:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382720 00000100:00100000:2.0:1788970681.772004:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:2.0:1788970681.772019:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+29:18787:x1875871082382720:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788970681.772066:0:25049:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970681.772859:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e5f840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22745:1875871102401536:192.168.203.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788970681.773201:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18787:x1875871082382720:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 1184us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.773212:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:0.0:1788970681.783173:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.784764:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082382848 00000100:00100000:1.0:1788970681.784787:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082382848 00000100:00100000:1.0:1788970681.784886:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:1.0:1788970681.784901:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18787:x1875871082382848:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788970681.785088:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785112:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785131:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785705:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785730:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785742:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785773:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785782:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785788:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788970681.785868:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788970681.785872:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788970681.785889:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785900:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785906:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785912:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785917:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970681.785921:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785929:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785940:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823eec00) 00010000:00010000:1.0:1788970681.785943:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970681.785948:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785953:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785967:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785983:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785989:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.785994:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9aa00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970681.785997:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786003:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786012:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8a7eb55b4b00) 00010000:00010000:1.0:1788970681.786014:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970681.786017:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786022:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786048:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786054:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786059:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786063:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970681.786072:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786077:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786085:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:1.0:1788970681.786087:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970681.786090:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.786095:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a4a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970681.786174:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18787:x1875871082382848:12345-192.168.203.15@tcp:34:lhsmtool_posix.0 Request processed in 1274us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970681.786196:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 50 00000100:00100000:2.0:1788970681.789310:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.790064:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082383104 00000100:00100000:3.0:1788970681.790091:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082383104 00000100:00100000:2.0:1788970681.790292:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:2.0:1788970681.790310:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+28:18787:x1875871082383104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970681.790341:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970681.790371:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dea5 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.790608:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.790629:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.790664:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788970681.790745:0:25049:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788970681.790855:0:25049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.790864:0:25049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.790872:0:25049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.793790:0:25049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654800 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.793821:0:25049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.793843:0:25049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.793869:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:2.0:1788970681.793873:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788970681.793879:0:25049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.793888:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.793986:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dea5 expref: 30 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.794030:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a7d823eec00) 00010000:00010000:2.0:1788970681.794033:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788970681.794037:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dea5 expref: 30 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.794050:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:2.0:1788970681.794161:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+29:18787:x1875871082383104:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 3856us (4864us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788970681.794174:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 51 00000100:00100000:0.0:1788970681.803565:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.803683:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082383232 00000100:00100000:1.0:1788970681.803701:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082383232 00000100:00100000:1.0:1788970681.803794:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:1.0:1788970681.803807:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+29:18787:x1875871082383232:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788970681.803845:0:22713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788970681.803986:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+29:18787:x1875871082383232:12345-192.168.203.15@tcp:53:lhsmtool_posix.0 Request processed in 181us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970681.803994:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 52 00000100:00100000:0.0:1788970681.810008:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.810113:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082383488 00000100:00100000:3.0:1788970681.810146:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082383488 00000100:00100000:3.0:1788970681.811467:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:3.0:1788970681.811489:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+29:18787:x1875871082383488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788970681.811521:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788970681.811983:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c70a66 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8deac expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788970681.814598:0:22712:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:2.0:1788970681.814610:0:22712:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1788970681.814635:0:22712:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788970681.815659:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a6d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.815680:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.815693:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.815774:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df2400/0xc3abfebe76c70a66 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deac expref: 32 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.815795:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a6d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deac expref: 31 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.815823:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7600) 00010000:00010000:2.0:1788970681.815827:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788970681.815831:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654800, rc 0) 00000100:00100000:2.0:1788970681.815894:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+31:18787:x1875871082383488:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 4413us (5900us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788970681.815904:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 53 00000100:00100000:2.0:1788970681.823359:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.823527:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082383744 00000100:00100000:1.0:1788970681.823537:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082383744 00000100:00100000:1.0:1788970681.823602:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:1.0:1788970681.823614:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+31:18787:x1875871082383744:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970681.823697:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788970681.823733:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654800/0xc3abfebe76c70a6d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deac expref: 31 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823753:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7600) 00010000:00010000:1.0:1788970681.823763:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788970681.823785:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823798:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823809:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823822:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823829:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823835:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823885:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823893:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823900:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823912:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9a200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970681.823917:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823924:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823932:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:1.0:1788970681.823935:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970681.823939:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823945:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9a200/0xc3abfebe76c70a7b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823955:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823961:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823967:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823973:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9aa00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:1.0:1788970681.823975:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823982:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.823999:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xbec19fe4 (ffff8a7eb55b4b00) 00010000:00010000:1.0:1788970681.824001:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788970681.824004:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.824010:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9aa00/0xc3abfebe76c70a82 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xbec19fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970681.824092:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+30:18787:x1875871082383744:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 481us (741us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788970681.824100:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 54 00000100:00100000:0.0:1788970681.826587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.826766:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082383872 00000100:00100000:2.0:1788970681.826779:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082383872 00000100:00100000:2.0:1788970681.826853:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:2.0:1788970681.826864:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+30:18787:x1875871082383872:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788970681.826891:0:25049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788970681.826920:0:25049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70a89 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8deb3 expref: -99 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.826967:0:25049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.826984:0:25049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.826997:0:25049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.827853:0:25049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654600/0xc3abfebe76c70a89 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deb3 expref: 32 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.827902:0:25049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654e00/0xc3abfebe76c70a90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deb3 expref: 31 pid: 25049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.827911:0:25049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:2.0:1788970681.827915:0:25049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788970681.827919:0:25049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7d82654e00, rc 0) 00000100:00100000:2.0:1788970681.828008:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+31:18787:x1875871082383872:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1145us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.828018:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 55 00000100:00100000:0.0:1788970681.832711:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.832819:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082384128 00000100:00100000:1.0:1788970681.832834:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082384128 00000100:00100000:1.0:1788970681.832908:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:1.0:1788970681.832920:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+31:18787:x1875871082384128:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788970681.833039:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.833062:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.833076:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788970681.833348:0:22711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788970681.833362:0:22711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701099979527ns, next at 702099976227ns, rc = 0 00000004:00010000:1.0:1788970681.833478:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051ee23ec reply state 00000000b340916f transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.833522:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.833531:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:1.0:1788970681.833535:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788970681.833540:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788970681.833682:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+33:18787:x1875871082384128:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 762us (985us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788970681.833691:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 56 00000100:00100000:3.0:1788970681.838299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.838428:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082384256 00000100:00100000:0.0:1788970681.838442:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082384256 00000100:00100000:0.0:1788970681.838517:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:0.0:1788970681.838531:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+33:18787:x1875871082384256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970681.838569:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970681.838599:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8deba expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.838689:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 34 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.838709:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 34 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.838731:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:0.0:1788970681.838735:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970681.838739:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a9600, rc 0) 00000100:00100000:0.0:1788970681.838820:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+34:18787:x1875871082384256:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 291us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970681.838827:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 57 00000100:00100000:2.0:1788970681.843529:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.843658:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082384384 00000100:00100000:1.0:1788970681.843673:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082384384 00000100:00100000:1.0:1788970681.843761:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00100000:1.0:1788970681.843774:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082384384:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788970681.844091:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2403:x1875871082384384:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 319us (576us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788970681.844099:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 24 00000100:00080000:3.0:1788970681.844329:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788970681.848757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.848918:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082384640 00000100:00100000:3.0:1788970681.848932:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082384640 00000100:00100000:3.0:1788970681.849002:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:3.0:1788970681.849016:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+34:18787:x1875871082384640:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788970681.849477:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+35:18787:x1875871082384640:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 463us (736us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788970681.849486:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 9 00000100:00100000:0.0:1788970681.854208:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.857361:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082384896 00000100:00100000:1.0:1788970681.857396:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082384896 00000100:00100000:1.0:1788970681.857521:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:1.0:1788970681.857535:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+35:18787:x1875871082384896:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788970681.857713:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+35:18787:x1875871082384896:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 181us (3520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970681.857721:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 58 00000100:00100000:2.0:1788970681.862868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.862989:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385024 00000100:00100000:0.0:1788970681.863018:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385024 00000100:00100000:0.0:1788970681.863233:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:0.0:1788970681.863247:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+35:18787:x1875871082385024:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970681.863276:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970681.863303:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c70aa5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dec1 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.863442:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.863462:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.863477:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788970681.863540:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788970681.863571:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.864248:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8600/0xc3abfebe76c70aa5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec1 expref: 37 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.864281:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec1 expref: 36 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.864292:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:0.0:1788970681.864296:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788970681.864301:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8400, rc 0) 00000100:00100000:0.0:1788970681.864459:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d83e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+36:18787:x1875871082385024:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 1214us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970681.864482:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 59 00000100:00100000:2.0:1788970681.868584:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.868828:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385152 00000100:00100000:0.0:1788970681.868844:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385152 00000100:00100000:0.0:1788970681.868931:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970681.868945:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2402:x1875871082385152:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788970681.868970:0:24221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970681.868999:0:24221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8dec8 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788970681.869034:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa186b9, blocks: 0x0 00010000:00010000:0.0:1788970681.869061:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:0.0:1788970681.869067:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970681.869078:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 7 pid: 24221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.869103:0:24221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 7 pid: 24221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.869120:0:24221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8a00, rc 0) 00000100:00100000:0.0:1788970681.869226:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d8356a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2402:x1875871082385152:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 284us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970681.869234:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 25 00000100:00100000:0.0:1788970681.872238:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.872317:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385408 00000100:00100000:1.0:1788970681.872442:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385408 00000100:00100000:3.0:1788970681.872596:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:3.0:1788970681.872669:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+36:18787:x1875871082385408:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788970681.872825:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+36:18787:x1875871082385408:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 160us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.872834:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 60 00000100:00100000:2.0:1788970681.876559:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.877134:0:25049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385536 00000100:00100000:2.0:1788970681.877149:0:25049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385536 00000100:00100000:2.0:1788970681.877344:0:25049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970681.877358:0:25049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+36:18787:x1875871082385536:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788970681.892563:0:22691:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788970681.892587:0:22691:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788970681.892673:0:22691:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1788970681.892893:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788970681.892920:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102401664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788970681.893014:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970681.893071:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102401664 00000100:00100000:1.0:1788970681.893079:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102401664 00000100:00100000:1.0:1788970681.893234:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788970681.893245:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eafc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102401664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788970681.893465:0:24366:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788970681.893470:0:24366:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788970681.893472:0:24366:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788970681.893474:0:24366:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788970681 -> 1788970681 00002000:00010000:1.0:1788970681.893477:0:24366:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788970681.893528:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eafc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875871102401664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 284us (513us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788970681.893535:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788970681.893721:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788970681.893760:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a7eb6e5cb40/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788970681.893766:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102401664:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788970681.894153:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894166:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894196:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894204:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:3.0:1788970681.894209:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894220:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894239:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:3.0:1788970681.894243:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788970681.894250:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.894258:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b200/0xc3abfebe76c70940 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894457:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894468:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894475:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894481:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.894490:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894497:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894506:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8a7d823e7200) 00010000:00010000:2.0:1788970681.894509:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970681.894512:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894518:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c708b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894538:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894544:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894550:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894555:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.894559:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894565:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894572:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8a7d823e7100) 00010000:00010000:2.0:1788970681.894575:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970681.894584:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894592:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c708bb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894606:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894611:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894616:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894621:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8200 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.894623:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894629:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894637:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8a7d83360400) 00010000:00010000:2.0:1788970681.894639:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970681.894642:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894648:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8200/0xc3abfebe76c7099b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25049 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894666:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894683:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894689:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894694:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3600 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.894697:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894703:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894712:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:2.0:1788970681.894714:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788970681.894717:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894723:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3600/0xc3abfebe76c70a20 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894737:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894745:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894751:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894758:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9be00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:2.0:1788970681.894767:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894774:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894783:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:2.0:1788970681.894786:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788970681.894790:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.894796:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9be00/0xc3abfebe76c70a97 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970681.898883:0:25049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+15:18787:x1875871082385536:12345-192.168.203.15@tcp:44:lhsmtool_posix.0 Request processed in 21507us (22333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.898904:0:25049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 61 00000100:00100000:2.0:1788970681.912455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.914454:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385664 00000100:00100000:0.0:1788970681.914473:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385664 00000100:00100000:0.0:1788970681.914571:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1788970681.914585:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2403:x1875871082385664:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788970681.914760:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2403:x1875871082385664:12345-192.168.203.15@tcp:16:lhsmtool_posix.0 Request processed in 177us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970681.914767:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 27 00000100:00100000:0.0:1788970681.921543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.925901:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082385920 00000100:00100000:3.0:1788970681.926034:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082385920 00000100:00100000:2.0:1788970681.926719:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:2.0:1788970681.926733:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+15:18787:x1875871082385920:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788970681.926817:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970681.926852:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aac lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec1 expref: 15 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.926878:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:2.0:1788970681.926885:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788970681.927198:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c70aba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.927217:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c70aba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.927229:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c70aba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788970681.927469:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000331f6008 reply state 00000000e1390d60 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c70aba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.927484:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654200/0xc3abfebe76c70aba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.927490:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:2.0:1788970681.927492:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788970681.927496:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788970681.927696:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:18787:x1875871082385920:12345-192.168.203.15@tcp:36:lhsmtool_posix.0 Request processed in 964us (6168us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788970681.927705:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 62 00000100:00100000:3.0:1788970681.940211:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970681.940448:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386048 00000100:00100000:1.0:1788970681.940461:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386048 00000100:00100000:1.0:1788970681.940536:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:1.0:1788970681.940549:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:18787:x1875871082386048:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788970681.940572:0:24366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788970681.940595:0:24366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8decf expref: -99 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.940658:0:24366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.940668:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970681.940673:0:24366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788970681.940680:0:24366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.940724:0:24366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970681.940911:0:24366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970681.941000:0:24366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24366:1875871102401792:192.168.203.15@tcp:104: 00000100:00100000:1.0:1788970681.941214:0:24366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7e8448b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788970681.951103:0:24366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24366:1875871102401792:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970681.951157:0:24366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.951192:0:24366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eaed9bc00, rc 0) 00000100:00100000:2.0:1788970681.951270:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:18787:x1875871082386048:12345-192.168.203.15@tcp:101:lhsmtool_posix.0 Request processed in 10722us (11074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.951282:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 28 00000100:00100000:0.0:1788970681.959000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.959222:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386176 00000100:00100000:2.0:1788970681.959235:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386176 00010000:00010000:2.0:1788970681.959292:0:22696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.959344:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:2.0:1788970681.959374:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:2403:x1875871082386176:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970681.959436:0:22696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970681.959465:0:22696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.959480:0:22696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.959508:0:22696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4d9067/0xc3abfebe76c70ab3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8dec8 expref: 8 pid: 24221 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.959530:0:22696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970681.959534:0:22696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970681.959541:0:22696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.959553:0:22696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.959600:0:22696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 7 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.959617:0:22696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22696:1875871102401920:192.168.203.15@tcp:105: 00000100:00100000:2.0:1788970681.959715:0:22696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970681.974006:0:22696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22696:1875871102401920:192.168.203.15@tcp:105: 00010000:00010000:2.0:1788970681.974061:0:22696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970681.974138:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2403:x1875871082386176:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 14765us (15149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.974151:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 19 00000100:00100000:1.0:1788970681.974965:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.975086:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386304 00000100:00100000:0.0:1788970681.975097:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386304 00000100:00100000:0.0:1788970681.975166:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:0.0:1788970681.975190:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2402:x1875871082386304:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788970681.975424:0:24221:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788970681.975428:0:24221:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788970681 00002000:00010000:0.0:1788970681.975431:0:24221:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788970680 00002000:00010000:0.0:1788970681.975434:0:24221:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788970681 -> 1788970681 00002000:00010000:0.0:1788970681.975436:0:24221:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788970681.975489:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:2402:x1875871082386304:12345-192.168.203.15@tcp:2:lhsmtool_posix.0 Request processed in 313us (528us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788970681.975497:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 29 00000100:00100000:0.0:1788970681.983378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970681.983869:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386432 00000100:00100000:2.0:1788970681.983883:0:24219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386432 00000100:00100000:2.0:1788970681.984112:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:2.0:1788970681.984126:0:24219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:2400:x1875871082386432:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788970681.984193:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.984220:0:24219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.984230:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970681.984236:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788970681.984241:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.984286:0:24219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 8 pid: 24366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.984303:0:24219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 8 pid: 24366 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.984319:0:24219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24219:1875871102402048:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970681.984475:0:24219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970681.990194:0:24219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24219:1875871102402048:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970681.990238:0:24219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970681.992998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970681.993108:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386560 00000100:00100000:3.0:1788970681.993122:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386560 00010000:00010000:3.0:1788970681.993195:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 9 pid: 24366 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970681.993275:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 20 00000100:00100000:3.0:1788970681.993288:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+9:2402:x1875871082386560:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788970681.993308:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788970681.993337:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 9 pid: 24366 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.993353:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 9 pid: 24366 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.993547:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d08457/0xc3abfebe76c70ac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8decf expref: 9 pid: 24366 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.993570:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970681.993575:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788970681.993582:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.993594:0:22698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970681.993632:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788970681.993703:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:2402:x1875871082386560:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 417us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970681.993711:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 20 00010000:00010000:2.0:1788970681.994123:0:24219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994138:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994168:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994186:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994196:0:24219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994204:0:24219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970681.994208:0:24219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994219:0:24219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994249:0:24219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970681.994259:0:24219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70ac8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970681.994337:0:24219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55e5d094-8e05-444c-a3e2-d2016031d5b4+7:2400:x1875871082386432:12345-192.168.203.15@tcp:1:lhsmtool_posix.0 Request processed in 10214us (10973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970681.994347:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 30 00000100:00100000:1.0:1788970681.996637:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970681.996823:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386816 00000100:00100000:0.0:1788970681.996836:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386816 00000100:00100000:0.0:1788970681.996910:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 63 00000100:00100000:0.0:1788970681.996988:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:18787:x1875871082386816:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788970681.997117:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.997140:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.997150:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.997210:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 16 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970681.997227:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 16 pid: 22713 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970681.997244:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402176:192.168.203.15@tcp:104: 00000100:00100000:0.0:1788970681.997420:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95240 going to sleep for 11 seconds 00000100:00100000:0.0:1788970682.002304:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402176:192.168.203.15@tcp:104: 00010000:00010000:0.0:1788970682.002344:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788970682.003017:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970682.003100:0:23467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082386944 00000100:00100000:0.0:1788970682.003110:0:23467:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082386944 00010000:00010000:0.0:1788970682.003371:0:23467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 17 pid: 22713 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970682.003459:0:23467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 21 00000100:00100000:0.0:1788970682.003470:0:23467:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+17:2403:x1875871082386944:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788970682.003508:0:23467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788970682.003518:0:23467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 17 pid: 22713 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003532:0:23467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 17 pid: 22713 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003559:0:23467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9ba00/0xc3abfebe76c70a19 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de90 expref: 17 pid: 22713 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003578:0:23467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970682.003586:0:23467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003597:0:23467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003606:0:23467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003615:0:23467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.003653:0:23467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788970682.003712:0:23467:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:2403:x1875871082386944:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 243us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970682.003720:0:23467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 21 00010000:00010000:3.0:1788970682.006969:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.006995:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788970682.007335:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788970682.007616:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.007648:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.007659:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.007710:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 16 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.007726:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 16 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970682.007753:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402304:192.168.203.15@tcp:104: 00000100:00100000:2.0:1788970682.007865:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7ea7689600 going to sleep for 11 seconds 00000100:00100000:2.0:1788970682.015772:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402304:192.168.203.15@tcp:104: 00010000:00010000:2.0:1788970682.015826:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788970682.018923:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:2.0:1788970682.019173:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387072 00000100:00100000:2.0:1788970682.019194:0:22698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387072 00010000:00010000:2.0:1788970682.019247:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 17 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970682.019299:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 22 00000100:00100000:2.0:1788970682.019311:0:22698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+17:2403:x1875871082387072:12345-192.168.203.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788970682.019333:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788970682.019340:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 17 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019356:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 17 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019413:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9600/0xc3abfebe76c70a9e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8deba expref: 17 pid: 22712 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019433:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:2.0:1788970682.019439:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019450:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019459:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.019516:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788970682.019590:0:22698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+16:2403:x1875871082387072:12345-192.168.203.15@tcp:103:ldlm_bl.0 Request processed in 281us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970682.019597:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 22 00010000:00010000:0.0:1788970682.019663:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.019682:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970682.020187:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788970682.020336:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788970682.020376:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788970682.020522:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22712:1875871102402432:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788970682.020589:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970682.020623:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95780 going to sleep for 11 seconds 00000100:00100000:2.0:1788970682.021106:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102402432 00000100:00100000:2.0:1788970682.021115:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102402432 00000100:00100000:2.0:1788970682.021190:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788970682.021200:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22712:x1875871102402432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788970682.021318:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22712:x1875871102402432:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970682.021326:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788970682.021715:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7e8949ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22712:1875871102402432:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788970682.022054:0:22712:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788970682.022262:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22712:1875871102402560:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788970682.022320:0:22712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970682.022442:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788970682.022528:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102402560 00000100:00100000:1.0:1788970682.022536:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102402560 00000100:00100000:1.0:1788970682.022618:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788970682.022629:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22712:x1875871102402560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788970682.022801:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22712:x1875871102402560:12345-0@lo:1000:mdt00_001.0 Request processed in 173us (481us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788970682.022809:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788970682.022876:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22712:1875871102402560:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788970682.022922:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.022933:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.022941:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.022948:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970682.022953:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.022972:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.022991:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:0.0:1788970682.022994:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970682.023000:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023006:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d82654400/0xc3abfebe76c70ad6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023048:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023055:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023061:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023066:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d83df3a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970682.023069:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023086:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023094:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970682.023097:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788970682.023104:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023129:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023138:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.023220:0:22712:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3e00/0xc3abfebe76c70a35 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8de9e expref: 19 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970682.023235:0:22712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402688:192.168.203.15@tcp:105: 00000100:00100000:0.0:1788970682.023328:0:22712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a7eb0c95480 going to sleep for 11 seconds 00000100:00100000:3.0:1788970682.027325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970682.027422:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387200 00000100:00100000:1.0:1788970682.027434:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387200 00000100:00100000:1.0:1788970682.027497:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:1.0:1788970682.027509:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaef93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18786:x1875871082387200:12345-192.168.203.15@tcp:49:dd.0 00000100:00100000:1.0:1788970682.027690:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaef93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18786:x1875871082387200:12345-192.168.203.15@tcp:49:dd.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970682.027698:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 10 00000100:00100000:0.0:1788970682.029273:0:22712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7d836b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1875871102402688:192.168.203.15@tcp:105: 00010000:00010000:0.0:1788970682.029317:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029331:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7d83df3a00/0xc3abfebe76c70a2e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029378:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029434:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029450:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029464:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029489:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029496:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029502:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a8a00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970682.029507:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.029516:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030376:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970682.030722:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788970682.030731:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030741:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8a00/0xc3abfebe76c70add lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030764:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030771:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030777:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030782:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9c00 already unused, calling callback (ffffffffc177d4f0) 00010000:00010000:0.0:1788970682.030802:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030811:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030825:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970682.030828:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970682.030830:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.030836:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9c00/0xc3abfebe76c70acf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788970682.031099:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+19:18787:x1875871082386816:12345-192.168.203.15@tcp:57:lhsmtool_posix.0 Request processed in 34174us (34471us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788970682.031111:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 63 00000020:00080000:0.0:1788970682.031119:0:22712:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788970682.031173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970682.031276:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387328 00000100:00100000:0.0:1788970682.031287:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387328 00000100:00100000:0.0:1788970682.031338:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 64 00000100:00100000:0.0:1788970682.031348:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+19:18786:x1875871082387328:12345-192.168.203.15@tcp:101:dd.0 00010000:00010000:0.0:1788970682.031374:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788970682.031429:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9400/0xc3abfebe76c70ae4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x89f4a47a6dd8ded6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031469:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aeb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031483:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aeb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031502:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aeb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031656:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a9400/0xc3abfebe76c70ae4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ded6 expref: 21 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031674:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eb59a8400/0xc3abfebe76c70aeb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.15@tcp remote: 0x89f4a47a6dd8ded6 expref: 20 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.031682:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8a7d83360800) 00010000:00010000:0.0:1788970682.031685:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788970682.031688:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a7eb59a8400, rc 0) 00000100:00100000:0.0:1788970682.031734:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d822d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18786:x1875871082387328:12345-192.168.203.15@tcp:101:dd.0 Request processed in 387us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970682.031740:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 64 00000040:00080000:2.0:1788970682.032017:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788970682.032023:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788970682.032047:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788970682.032054:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788970682.034188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:1.0:1788970682.034303:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387584 00000100:00100000:1.0:1788970682.034316:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387584 00000100:00100000:1.0:1788970682.034617:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 11 00000100:00100000:1.0:1788970682.034630:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+20:18787:x1875871082387584:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788970682.035358:0:22715:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788970682.035421:0:22715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788970682.035459:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035478:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035492:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035502:0:22715:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035527:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035588:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788970682.035614:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788970682.035753:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+22:18787:x1875871082387584:12345-192.168.203.15@tcp:35:lhsmtool_posix.0 Request processed in 1124us (1584us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788970682.035764:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 11 00000020:00080000:1.0:1788970682.035771:0:22715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788970682.036234:0:24370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788970682.036243:0:24370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.036252:0:24370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eaed9b800 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:3.0:1788970682.036256:0:24370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.036265:0:24370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.036279:0:24370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8a7d823e7d00) 00010000:00010000:3.0:1788970682.036283:0:24370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788970682.036288:0:24370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.036295:0:24370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a7eaed9b800/0xc3abfebe76c70af2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788970682.036310:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970682.036312:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788970682.036313:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788970682.154316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:3.0:1788970682.154429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970682.154519:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387712 00000100:00100000:0.0:1788970682.154532:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387712 00000100:00100000:0.0:1788970682.154627:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387840 00000100:00100000:0.0:1788970682.154631:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387840 00000100:00100000:0.0:1788970682.154660:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:0.0:1788970682.154673:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebba8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+8:2402:x1875871082387712:12345-192.168.203.15@tcp:4:dd.0 00002000:00010000:0.0:1788970682.154741:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa186b9, atime: 0x6aa186b8, ctime: 0x6aa186b9, blocks: 0x0 00010000:00010000:0.0:1788970682.154754:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.154775:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:0.0:1788970682.154780:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788970682.154813:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788970682.154833:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970682.259374:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1788970682.259459:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1788970682.259774:0:24225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1788970682.259781:0:24225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788970681 -> 1788970682 00002000:00010000:2.0:1788970682.259783:0:24225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788970681 -> 1788970682 00002000:00010000:2.0:1788970682.259786:0:24225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1788970682.259808:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259824:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259835:0:24225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259865:0:24225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7eb59a9400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970682.259871:0:24225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259881:0:24225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259909:0:24225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.259917:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000525c8f25/0xc3abfebe76c70af9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970682.260083:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebba8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+6:2402:x1875871082387712:12345-192.168.203.15@tcp:4:dd.0 Request processed in 105405us (105773us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788970682.260102:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 0 00000100:00100000:2.0:1788970682.260148:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 1 00000100:00100000:2.0:1788970682.260162:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082387840:12345-192.168.203.15@tcp:4:dd.0 00002000:00010000:2.0:1788970682.260229:0:24225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6aa186ba, atime: 0x6aa186b8, ctime: 0x6aa186ba, blocks: 0x2000 00010000:00010000:2.0:1788970682.260237:0:24225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.260252:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=701s v=(0 0) 00010000:00010000:2.0:1788970682.260257:0:24225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788970682.260266:0:24225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.260289:0:24225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788970682.333470:0:24215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788970682.334270:0:24225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788970682.334279:0:24225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788970682.334302:0:24225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334318:0:24225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334327:0:24225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334337:0:24225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a7d82654400 already unused, calling callback (ffffffffc0b518b0) 00010000:00010000:2.0:1788970682.334342:0:24225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334353:0:24225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334477:0:24225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788970682.334488:0:24225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8658787/0xc3abfebe76c70b00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788970682.334837:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7ebf375a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082387840:12345-192.168.203.15@tcp:4:dd.0 Request processed in 74672us (180448us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788970682.334851:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 1 00010000:00010000:3.0:1788970682.460768:0:22699:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970682.653041:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788970682.653075:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102402816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788970682.653188:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970682.653289:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102402816 00000100:00100000:2.0:1788970682.653301:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102402816 00000100:00100000:2.0:1788970682.653409:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970682.653420:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102402816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788970682.653453:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1788970682.653516:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102402816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970682.653523:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788970682.653582:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf374b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102402816:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788970682.653696:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788970683.485634:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788970683.676922:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102402944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788970683.677038:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970683.681225:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102402944 00000100:00100000:1.0:1788970683.681249:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102402944 00000100:00100000:1.0:1788970683.681337:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788970683.681351:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102402944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788970683.681403:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1788970683.681518:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102402944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970683.681526:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788970683.681550:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788970683.681559:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1788970683.681577:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a7eb6e5cb40, transno 12884901892 00000004:00080000:0.0:1788970683.682199:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1788970683.682244:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102402944:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788970684.026280:0:25795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788970684.098551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098661:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098680:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.15@tcp (source: 12345-192.168.203.15@tcp) 00000100:00100000:0.0:1788970684.098807:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388480 00000100:00100000:0.0:1788970684.098818:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388480 00000100:00100000:0.0:1788970684.098863:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388992 00000100:00100000:0.0:1788970684.098866:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388992 00000100:00100000:0.0:1788970684.098880:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388352 00000100:00100000:0.0:1788970684.098883:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388352 00000100:00100000:0.0:1788970684.098896:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388864 00000100:00100000:0.0:1788970684.098899:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388864 00000100:00100000:0.0:1788970684.098915:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970684.098924:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388480:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.098994:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388480:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 70us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099001:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 14 00000100:00100000:0.0:1788970684.099018:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970684.099025:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388992:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099050:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388992:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099056:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 15 00000100:00100000:0.0:1788970684.099067:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970684.099073:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388352:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099096:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf375680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388352:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099102:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 16 00000100:00100000:0.0:1788970684.099114:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970684.099120:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388864:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099151:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388864:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 31us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099157:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 17 00000100:00100000:0.0:1788970684.099190:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388224 00000100:00100000:0.0:1788970684.099194:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388224 00000100:00100000:0.0:1788970684.099216:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388736 00000100:00100000:0.0:1788970684.099218:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388736 00000100:00100000:0.0:1788970684.099231:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388096 00000100:00100000:0.0:1788970684.099234:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388096 00000100:00100000:0.0:1788970684.099245:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082388608 00000100:00100000:0.0:1788970684.099248:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082388608 00000100:00100000:0.0:1788970684.099261:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1788970684.099267:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388224:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099294:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7d836b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+5:2403:x1875871082388224:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099301:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 46 00000100:00100000:0.0:1788970684.099313:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1788970684.099319:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388736:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099342:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8949ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+5:2403:x1875871082388736:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 23us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099347:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 47 00000100:00100000:0.0:1788970684.099358:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1788970684.099364:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+22:2403:x1875871082388096:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099424:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55e5d094-8e05-444c-a3e2-d2016031d5b4+22:2403:x1875871082388096:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 59us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099439:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 48 00000100:00100000:0.0:1788970684.099452:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:0.0:1788970684.099458:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+6:2403:x1875871082388608:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:0.0:1788970684.099484:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c393749-293e-4642-ade1-b2d863b30114+6:2403:x1875871082388608:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 26us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.099489:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 49 00000100:00100000:1.0:1788970684.099639:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871082387968 00000100:00100000:1.0:1788970684.099644:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871082387968 00000100:00100000:1.0:1788970684.099677:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00100000:1.0:1788970684.099684:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:2403:x1875871082387968:12345-192.168.203.15@tcp:400:kworker.0 00000100:00100000:1.0:1788970684.099707:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:934ded50-4656-4f1c-aa47-e2fbf1604b86+13:2403:x1875871082387968:12345-192.168.203.15@tcp:400:kworker.0 Request processed in 24us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970684.099722:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.15@tcp, seq: 162 00000100:00080000:1.0:1788970684.099753:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788970684.099758:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788970684.099760:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970684.099762:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788970684.188718:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102403072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788970684.188788:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970684.195605:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102403200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788970684.195695:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788970684.195766:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403072 00000100:00100000:2.0:1788970684.195775:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403072 00000100:00100000:2.0:1788970684.195823:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403200 00000100:00100000:2.0:1788970684.195826:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403200 00000100:00100000:2.0:1788970684.195843:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788970684.195853:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102403072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788970684.195871:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970684.195883:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102403200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788970684.195889:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000004:00000024:1.0:1788970684.195906:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788970684.195949:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102403200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970684.195956:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788970684.196371:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7ebf3743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102403200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788970684.199449:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102403072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3579us (10643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970684.199464:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788970684.201922:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102403072:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788970684.508705:0:24370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788970684.700755:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102403328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970684.700829:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.700959:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102403456:0@lo:400:kworker.0 00000100:00100000:3.0:1788970684.700984:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403328 00000100:00100000:3.0:1788970684.700993:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403328 00000100:00100000:0.0:1788970684.700995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788970684.701050:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788970684.701050:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403456 00000100:00100000:0.0:1788970684.701056:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403456 00000100:00100000:3.0:1788970684.701063:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3649:x1875871102403328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701092:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970684.701100:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102403456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701143:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875871102403456:12345-0@lo:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.701150:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788970684.701206:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e13840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3650:1875871102403456:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701226:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eaf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102403584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970684.701253:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701317:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102403712:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701352:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701422:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701449:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701473:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102404736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788970684.701497:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701514:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788970684.701531:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102404096:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701552:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701568:0:3652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102404608:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701586:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.701611:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403712 00000100:00100000:0.0:1788970684.701615:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403712 00000100:00100000:0.0:1788970684.701636:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404224 00000100:00100000:0.0:1788970684.701638:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404224 00000100:00100000:0.0:1788970684.701660:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404096 00000100:00100000:0.0:1788970684.701662:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404096 00000100:00100000:2.0:1788970684.701674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.701675:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404608 00000100:00100000:0.0:1788970684.701679:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404608 00000100:00100000:0.0:1788970684.701700:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970684.701708:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.701714:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788970684.701872:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e12d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6508eee8-107f-49e3-8ffd-bb9a27e50b6d:3649:1875871102403328:0@lo:400:kworker.0 00000100:00100000:1.0:1788970684.701888:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702117:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875871102403712:12345-0@lo:400:kworker.0 Request processed in 409us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702125:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788970684.702140:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970684.702146:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102404224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702190:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875871102404224:12345-0@lo:400:kworker.0 Request processed in 44us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702196:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788970684.702217:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970684.702224:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702252:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf375a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875871102404096:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702258:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788970684.702269:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788970684.702275:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.702348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102404480:0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.702374:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.702425:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf376580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875871102404608:12345-0@lo:400:kworker.0 Request processed in 149us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702432:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788970684.702445:0:24366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403968 00000100:00100000:0.0:1788970684.702445:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404480 00000100:00100000:0.0:1788970684.702452:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404480 00000100:00100000:2.0:1788970684.702453:0:24366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403968 00000100:00100000:0.0:1788970684.702484:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788970684.702495:0:24366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970684.702496:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702532:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875871102404480:12345-0@lo:400:kworker.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702538:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788970684.702572:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875871102404096:0@lo:400:kworker.0 00010000:00080000:0.0:1788970684.702592:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb6e11680 x1875871102404608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970684.702605:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e11680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3652:1875871102404608:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702615:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3652:1875871102404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.702620:0:24366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702625:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875871102403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.702666:0:24366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875871102403968:12345-0@lo:400:kworker.0 Request processed in 163us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970684.702674:0:24366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788970684.702684:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403584 00000100:00100000:0.0:1788970684.702695:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403584 00000100:00100000:2.0:1788970684.702709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3650:1875871102403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702722:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404736 00000100:00100000:2.0:1788970684.702725:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3650:1875871102404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.702727:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404736 00000100:00100000:0.0:1788970684.702746:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970684.702753:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102403584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788970684.702787:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1788970684.702794:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788970684.702801:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788970684.702804:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788970684.702968:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf374f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875871102403584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.702975:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788970684.702988:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788970684.702994:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eaf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102404736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788970684.703005:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788970684.703082:0:3652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e12940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3652:1875871102404736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788970684.703298:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7e8eb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6508eee8-107f-49e3-8ffd-bb9a27e50b6d+24:3649:x1875871102403328:12345-0@lo:400:kworker.0 Request processed in 2237us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788970684.703308:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788970684.703364:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eaf375e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3651:1875871102403584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788970684.703582:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eaf3770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875871102404736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 586us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788970684.703591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.703595:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788970684.703661:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a7eb6e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102404352:0@lo:400:kworker.0 00000100:00100000:1.0:1788970684.703694:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788970684.703898:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102404352 00000100:00100000:0.0:1788970684.703904:0:22712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102404352 00000100:00100000:0.0:1788970684.704225:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788970684.704234:0:22712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788970684.704281:0:22712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875871102404352:12345-0@lo:400:kworker.0 Request processed in 49us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788970684.704288:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788970684.704330:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a7eb6e10000 x1875871102404352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788970700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788970684.704341:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3649:1875871102404352:0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.704470:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875871102403840 00000100:00100000:2.0:1788970684.704476:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875871102403840 00000100:00100000:2.0:1788970684.704738:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788970684.704746:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a7eb6e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788970684.704800:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a7eb6e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875871102403840:12345-0@lo:400:kworker.0 Request processed in 55us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788970684.704806:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788970684.704909:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788970684.704914:0:22707:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788970684.705220:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a7eb6e130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3649:1875871102403840:0@lo:400:kworker.0 Debug log: 13648 lines, 13648 kept, 0 dropped, 0 bad.