00010000:00010000:3.0F:1790773378.253432:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773379.277890:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0F:1790773379.860413:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790773379.860429:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773379.860694:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790773379.860703:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:0.0:1790773379.919139:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1790773379.919156:0:17102:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d14465a300 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1790773379.919161:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d26ee5a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d14465a6c0 00000020:00080000:0.0:1790773379.919163:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d26ee5ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d27ffd0800 00000020:00080000:0.0:1790773379.919189:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1790773379.919274:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1790773379.919629:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919642:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919650:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919656:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240031800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773379.919661:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919669:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919685:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:3.0:1790773379.919688:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773379.919692:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773379.919698:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031800/0xabf1cc0bc7843241 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0F:1790773380.301342:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1790773380.444435:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773380.445976:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531456 00000100:00100000:1.0:1790773380.445991:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531456 00000100:00100000:1.0:1790773380.446067:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1790773380.446079:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+13:15544:x1877761484531456:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790773380.446191:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:332c789e-f22c-433e-a652-7f15822046a7+13:15544:x1877761484531456:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 114us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773380.446200:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00080000:2.0:1790773380.446926:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773380.455461:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773380.456293:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531584 00000100:00100000:1.0:1790773380.456306:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531584 00000100:00100000:1.0:1790773380.456380:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1790773380.456393:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+5:15544:x1877761484531584:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790773380.456499:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+5:15544:x1877761484531584:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 110us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773380.456507:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00080000:3.0:1790773380.458112:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773380.465028:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773380.465349:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531840 00000100:00100000:2.0:1790773380.465360:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531840 00000100:00100000:2.0:1790773380.465420:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773380.465431:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+13:15544:x1877761484531840:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790773380.465688:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+14:15544:x1877761484531840:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 258us (671us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1790773380.465696:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1790773380.941709:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790773380.941728:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496132992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773380.941789:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773380.942227:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496132992 00000100:00100000:2.0:1790773380.942236:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496132992 00000100:00100000:2.0:1790773380.942305:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773380.942314:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496132992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773380.942344:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773380.942386:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496132992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773380.942391:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790773380.943035:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496132992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1790773380.943150:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790773381.325482:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773381.966361:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496133120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773381.966433:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773381.967002:0:17128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133120 00000100:00100000:1.0:1790773381.967012:0:17128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133120 00000100:00100000:1.0:1790773381.967072:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773381.967082:0:17128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496133120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773381.967120:0:17128:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1790773381.967290:0:17128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496133120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 208us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773381.967298:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790773381.967424:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496133120:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1790773382.094704:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1790773382.206009:0:20498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:03:01 (1790773381) 00010000:00010000:3.0:1790773382.349368:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773382.482622:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496133632:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.482704:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.482760:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496134144:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.482784:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.482801:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496134656:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.482823:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.482850:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1790773382.482856:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496133504:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.482877:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.483046:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496134016:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.483069:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.483088:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496134528:0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.483108:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773382.483126:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496135040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773382.483149:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773382.483340:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134656 00000100:00100000:3.0:1790773382.483351:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134656 00000100:00100000:3.0:1790773382.483568:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134528 00000100:00100000:3.0:1790773382.483579:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134528 00000100:00100000:3.0:1790773382.483677:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790773382.483688:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773382.483765:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1877761496134656:12345-0@lo:400:kworker.0 Request processed in 80us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773382.483772:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790773382.483791:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790773382.483798:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773382.483828:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496134528:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773382.483835:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1790773382.484088:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447dd180 x1877761496134528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773382.484104:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496134528:0@lo:400:kworker.0 00000100:00100000:3.0:1790773382.484118:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3605:1877761496134656:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.485730:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496133248:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.485802:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.485847:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496133760:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.485876:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.485913:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496134272:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.485936:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.485955:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496134784:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.485978:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.486000:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1790773382.486007:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496133376:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486031:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.486048:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496133888:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486082:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.486101:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496134400:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486120:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.486131:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773382.486152:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.486534:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133632 00000100:00100000:1.0:1790773382.486542:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133632 00000100:00100000:1.0:1790773382.486585:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134144 00000100:00100000:1.0:1790773382.486589:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134144 00000100:00100000:1.0:1790773382.486601:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133504 00000100:00100000:1.0:1790773382.486603:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133504 00000100:00100000:1.0:1790773382.486614:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134016 00000100:00100000:1.0:1790773382.486617:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134016 00000100:00100000:1.0:1790773382.486632:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790773382.486640:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486697:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496133632:12345-0@lo:400:kworker.0 Request processed in 58us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.486706:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790773382.486723:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773382.486729:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496134144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486754:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496134144:12345-0@lo:400:kworker.0 Request processed in 26us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.486760:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773382.486770:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773382.486776:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496133504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486802:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496133504:12345-0@lo:400:kworker.0 Request processed in 28us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.486807:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773382.486817:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773382.486823:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.486849:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496134016:12345-0@lo:400:kworker.0 Request processed in 26us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.486855:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773382.486877:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133760 00000100:00100000:1.0:1790773382.486881:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133760 00000100:00100000:2.0:1790773382.486953:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135040 00000100:00100000:2.0:1790773382.486958:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135040 00000100:00100000:2.0:1790773382.486978:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134912 00000100:00100000:2.0:1790773382.486980:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134912 00000100:00100000:2.0:1790773382.486992:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773382.486998:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496135040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773382.487018:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790773382.487053:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496135040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773382.487059:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773382.487072:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790773382.487086:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496134912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773382.487102:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773382.487129:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496134912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773382.487134:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1790773382.488640:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773382.488648:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773382.488651:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773382.488654:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773382.490340:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134272 00000100:00100000:0.0:1790773382.490363:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134272 00000100:00100000:0.0:1790773382.490413:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134784 00000100:00100000:0.0:1790773382.490416:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134784 00000100:00100000:0.0:1790773382.490442:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496134400 00000100:00100000:0.0:1790773382.490446:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496134400 00000100:00100000:0.0:1790773382.490465:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773382.490474:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496134272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.490580:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496134272:12345-0@lo:400:kworker.0 Request processed in 106us (4642us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.490588:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773382.490607:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773382.490613:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.490642:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496134784:12345-0@lo:400:kworker.0 Request processed in 29us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.490648:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773382.490659:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790773382.490665:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496134400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.490701:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496134400:12345-0@lo:400:kworker.0 Request processed in 36us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.490707:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790773382.490730:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133248 00000100:00100000:0.0:1790773382.490733:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133248 00000100:00100000:0.0:1790773382.490769:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790773382.490775:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3606:x1877761496133248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773382.490806:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3606:x1877761496133248:12345-0@lo:400:kworker.0 Request processed in 31us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.490811:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1790773382.493106:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773382.493115:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773382.494098:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773382.494113:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496133760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494199:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496133760:12345-0@lo:400:kworker.0 Request processed in 91us (8321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.494235:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790773382.494275:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133376 00000100:00100000:1.0:1790773382.494284:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133376 00000100:00100000:1.0:1790773382.494308:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496133888 00000100:00100000:1.0:1790773382.494312:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496133888 00000100:00100000:1.0:1790773382.494325:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790773382.494331:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494369:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496133376:12345-0@lo:400:kworker.0 Request processed in 38us (8336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.494375:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790773382.494386:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790773382.494392:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496133888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494421:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496133888:12345-0@lo:400:kworker.0 Request processed in 29us (8339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.494426:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790773382.494456:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773382.494473:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496135168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773382.494530:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.494579:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496135296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773382.494605:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773382.494640:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496133376:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494652:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496133888:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494668:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496134400:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494687:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773382.494699:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496133248:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494721:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496133760:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.494734:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496134272:0@lo:400:kworker.0 00010000:00080000:1.0:1790773382.494749:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447dca80 x1877761496134784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773382.494760:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496134784:0@lo:400:kworker.0 00000100:00100000:2.0:1790773382.495320:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135168 00000100:00100000:2.0:1790773382.495329:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135168 00000100:00100000:2.0:1790773382.495370:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773382.495379:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496135168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790773382.495412:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790773382.495459:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496135168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773382.495468:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790773382.495503:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496135168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773382.497327:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135296 00000100:00100000:1.0:1790773382.497345:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135296 00000100:00100000:1.0:1790773382.497616:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790773382.497626:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496135296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773382.497661:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773382.497738:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496135296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.497745:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790773382.497797:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496135296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773382.497852:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496133504:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.497863:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496134016:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.497878:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496135040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790773382.497888:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496133632:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.497913:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496134144:0@lo:400:kworker.0 00000100:00100000:1.0:1790773382.701527:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773382.701571:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773382.701603:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773382.701709:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532224 00000100:00100000:3.0:1790773382.701719:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532224 00000100:00100000:3.0:1790773382.701786:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532096 00000100:00100000:3.0:1790773382.701789:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532096 00000100:00100000:3.0:1790773382.701818:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1790773382.701828:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2399:x1877761484532224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773382.701952:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+5:2399:x1877761484532224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 126us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773382.701960:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1790773382.701981:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1790773382.701996:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+14:2399:x1877761484532096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773382.702030:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:332c789e-f22c-433e-a652-7f15822046a7+14:2399:x1877761484532096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773382.702037:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00080000:1.0:1790773382.702166:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790773382.702172:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790773382.702252:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484531968 00000100:00100000:2.0:1790773382.702257:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484531968 00000100:00100000:2.0:1790773382.702296:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:2.0:1790773382.702304:0:17115:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2399:x1877761484531968:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773382.702331:0:17115:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2399:x1877761484531968:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 29us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773382.702337:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:2.0:1790773382.717873:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773382.717975:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773382.718094:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773382.718146:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532480 00000100:00100000:1.0:1790773382.718156:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532480 00000100:00100000:1.0:1790773382.718265:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532352 00000100:00100000:1.0:1790773382.718269:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532352 00000100:00100000:1.0:1790773382.718291:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1790773382.718301:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484532480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773382.718381:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2400:x1877761484532480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.718389:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1790773382.718411:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1790773382.718419:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2396:x1877761484532352:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:1.0:1790773382.718439:0:19515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842f70 00000100:00080000:1.0:1790773382.718453:0:19515:0:(import.c:65:import_set_state_nolock()) ffff93d14338b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773382.718496:0:19515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790773382.718613:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+2:2396:x1877761484532352:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 195us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.718620:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00010000:00010000:1.0:1790773382.718640:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773382.718841:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773382.718846:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773382.719044:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773382.719111:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532864 00000100:00100000:0.0:1790773382.719116:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532864 00000100:00100000:0.0:1790773382.719158:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532992 00000100:00100000:0.0:1790773382.719161:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532992 00000100:00100000:0.0:1790773382.719181:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1790773382.719189:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2396:x1877761484532864:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:0.0:1790773382.719229:0:19515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842faf 00000100:00080000:0.0:1790773382.719235:0:19515:0:(import.c:65:import_set_state_nolock()) ffff93d27ff73800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773382.719267:0:19515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790773382.719344:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+2:2396:x1877761484532864:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 156us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.719352:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1790773382.719365:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1790773382.719370:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2396:x1877761484532992:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:0.0:1790773382.719395:0:19515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842fb6 00000100:00080000:0.0:1790773382.719401:0:19515:0:(import.c:65:import_set_state_nolock()) ffff93d24402e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773382.719422:0:19515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790773382.719494:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+2:2396:x1877761484532992:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 123us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773382.719501:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:0.0:1790773382.719516:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773382.719521:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773382.719622:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773382.719631:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773382.720828:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773382.720937:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773382.721107:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532608 00000100:00100000:3.0:1790773382.721115:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532608 00000100:00100000:3.0:1790773382.721295:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484532736 00000100:00100000:3.0:1790773382.721299:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484532736 00000100:00100000:1.0:1790773382.721354:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:1.0:1790773382.721365:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2399:x1877761484532608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773382.721431:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2399:x1877761484532608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 68us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773382.721449:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00080000:2.0:1790773382.725317:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773382.725328:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790773382.726131:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:3.0:1790773382.726147:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484532736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773382.726403:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2400:x1877761484532736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 260us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773382.726412:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00010000:00010000:1.0:1790773383.374296:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773384.397470:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773385.421816:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773385.623343:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773385.623418:0:17125:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484533248 00000100:00100000:2.0:1790773385.623428:0:17125:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484533248 00000100:00100000:2.0:1790773385.623532:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1790773385.623545:0:17125:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+14:16298:x1877761484533248:12345-192.168.202.19@tcp:35:umount.0 00000001:00080000:2.0:1790773385.623834:0:17125:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1790773385.623945:0:17125:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1790773385.624085:0:17125:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:332c789e-f22c-433e-a652-7f15822046a7+17:16298:x1877761484533248:12345-192.168.202.19@tcp:35:umount.0 Request processed in 542us (750us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1790773385.624107:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000020:00080000:2.0:1790773385.624113:0:17125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1790773385.624714:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1790773385.627953:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00080000:0.0:1790773385.627975:0:17102:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000100:00100000:0.0:1790773385.628580:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000020:00080000:2.0:1790773385.628667:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1790773385.628678:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1790773385.628735:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773385.628765:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773385.628813:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773385.628842:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484533504 00000100:00100000:0.0:1790773385.628851:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484533504 00000100:00100000:0.0:1790773385.628914:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484533760 00000100:00100000:0.0:1790773385.628917:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484533760 00000100:00100000:0.0:1790773385.628929:0:17107:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484533632 00000100:00100000:0.0:1790773385.628931:0:17107:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484533632 00000100:00100000:0.0:1790773385.628949:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773385.628958:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+15:2398:x1877761484533504:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773385.628974:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773385.628991:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a000/0xabf1cc0bc7842f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf83 expref: 15 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.629023:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773385.629072:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+14:2398:x1877761484533504:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773385.629080:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773385.629098:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1790773385.629104:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+13:2398:x1877761484533760:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773385.629111:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773385.629119:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d2532e4e00/0xabf1cc0bc7842fd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c06a expref: 13 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.629129:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773385.629145:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:2398:x1877761484533760:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 42us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773385.629152:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1790773385.629163:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1790773385.629169:0:17107:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:2398:x1877761484533632:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790773385.629175:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773385.629183:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b800/0xabf1cc0bc7842f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bfb4 expref: 11 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.629192:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773385.629935:0:17107:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:2398:x1877761484533632:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 758us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773385.629944:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773385.631146:0:19515:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484533376 00000100:00100000:1.0:1790773385.631160:0:19515:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484533376 00000100:00100000:1.0:1790773385.631428:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1790773385.631438:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+5:2396:x1877761484533376:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:1.0:1790773385.631485:0:19515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842f77 00000100:00080000:1.0:1790773385.631495:0:19515:0:(import.c:65:import_set_state_nolock()) ffff93d14338f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773385.631594:0:19515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790773385.631735:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:332c789e-f22c-433e-a652-7f15822046a7+2:2396:x1877761484533376:12345-192.168.202.19@tcp:9:umount.0 Request processed in 297us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773385.631743:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00080000:0.0:1790773385.632782:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790773385.639712:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773385.640894:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773385.641044:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484534656 00000100:00100000:1.0:1790773385.641055:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484534656 00000100:00100000:1.0:1790773385.641126:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1790773385.641136:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+13:2396:x1877761484534656:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:1.0:1790773385.641174:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842f62 00000020:00010000:1.0:1790773385.641194:0:17122:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d141c41000: total 0 00000100:00080000:1.0:1790773385.641200:0:17122:0:(import.c:65:import_set_state_nolock()) ffff93d141c40800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773385.641574:0:17122:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1790773385.641754:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:332c789e-f22c-433e-a652-7f15822046a7+12:2396:x1877761484534656:12345-192.168.202.19@tcp:39:umount.0 Request processed in 618us (867us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1790773385.641763:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000020:00010000:0.0:1790773385.646375:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d141c41000: total 0 00010000:00010000:0.0:1790773385.646386:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773385.646464:0:17111:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d141c41000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1790773385.646509:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d26ff64e00) 00010000:00010000:0.0:1790773385.646514:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773385.646524:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843049 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c078 expref: 11 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646550:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:0.0:1790773385.646552:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773385.646556:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526a00/0xabf1cc0bc7843088 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c086 expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646569:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d26ff73600) 00010000:00010000:0.0:1790773385.646571:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773385.646575:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843217 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c104 expref: 9 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646592:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773385.646595:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790773385.646598:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc784326b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c120 expref: 8 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646611:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d26ff73900) 00010000:00010000:0.0:1790773385.646613:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790773385.646617:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527000/0xabf1cc0bc784302d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c071 expref: 7 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646630:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d26ff64100) 00010000:00010000:0.0:1790773385.646658:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790773385.646662:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4800/0xabf1cc0bc784310d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0b0 expref: 6 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646676:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773385.646678:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773385.646680:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d240031a00/0xabf1cc0bc78431bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0ef expref: 5 pid: 19912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646688:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d254e30200) 00010000:00010000:0.0:1790773385.646690:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790773385.646692:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5400/0xabf1cc0bc784318b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c0da expref: 4 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773385.646702:0:17111:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d141c41000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1790773385.646712:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773385.646713:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773385.646715:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773385.659557:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773385.663393:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484534784 00000100:00100000:0.0:1790773385.663410:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484534784 00000100:00100000:0.0:1790773385.663509:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1790773385.663520:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+5:2396:x1877761484534784:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:0.0:1790773385.663555:0:19912:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842f69 00000100:00080000:0.0:1790773385.663577:0:19912:0:(import.c:65:import_set_state_nolock()) ffff93d141c42000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773385.663599:0:19912:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1790773385.663754:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773385.663953:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773385.664700:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:332c789e-f22c-433e-a652-7f15822046a7+3:2396:x1877761484534784:12345-192.168.202.19@tcp:39:umount.0 Request processed in 1176us (5147us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1790773385.664712:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1790773386.061864:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496135424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773386.061938:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773386.062118:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135424 00000100:00100000:3.0:1790773386.062128:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135424 00000100:00100000:3.0:1790773386.062234:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773386.062246:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496135424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773386.062278:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1790773386.062353:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773386.069976:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496135424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7721us (8025us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773386.069992:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773386.071009:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496135424:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790773386.445521:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773387.086325:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496135552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773387.086407:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.086684:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135552 00000100:00100000:3.0:1790773387.086694:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135552 00000100:00100000:3.0:1790773387.086743:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790773387.086769:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496135552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773387.086807:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1790773387.086882:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496135552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.086889:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773387.087045:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496135552:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773387.474543:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773387.597419:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496135808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773387.597500:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.597538:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773387.597553:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496135936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773387.597585:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773387.597586:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27ff26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496135680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773387.597608:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.597626:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135936 00000100:00100000:3.0:1790773387.597634:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135936 00000100:00100000:2.0:1790773387.597646:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135808 00000100:00100000:2.0:1790773387.597648:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135808 00000100:00100000:2.0:1790773387.597676:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496135680 00000100:00100000:3.0:1790773387.597684:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773387.597691:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496135680 00000100:00100000:3.0:1790773387.597692:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496135936:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773387.597707:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773387.597712:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496135808:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1790773387.597725:0:17127:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00002000:00000024:2.0:1790773387.597729:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790773387.597771:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496135936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773387.597771:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496135808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.597779:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773387.597779:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773387.597795:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773387.597801:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496135680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773387.597809:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790773387.597822:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496135936:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1790773387.597858:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790773387.597885:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496135808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773387.597979:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496135680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773387.597986:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790773387.598012:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27ff26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496135680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773387.598173:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773387.598193:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496136064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773387.598244:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773387.598307:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136064 00000100:00100000:2.0:1790773387.598312:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136064 00000100:00100000:2.0:1790773387.598350:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773387.598357:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496136064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773387.598375:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773387.598403:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496136064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773387.598409:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790773387.598433:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496136192:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598445:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496136576:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.598460:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598467:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598480:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496137088:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.598480:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496136704:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598501:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773387.598504:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496136320:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598534:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790773387.598534:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598539:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496136448:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.598547:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496136832:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598558:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773387.598562:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598572:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496136960:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.598575:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773387.598580:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496137216:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598590:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773387.598609:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598618:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137088 00000100:00100000:3.0:1790773387.598622:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137088 00000100:00100000:2.0:1790773387.598627:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136448 00000100:00100000:2.0:1790773387.598629:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136448 00000100:00100000:3.0:1790773387.598643:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136320 00000100:00100000:3.0:1790773387.598646:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136320 00000100:00100000:2.0:1790773387.598647:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773387.598652:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496136448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598656:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136832 00000100:00100000:3.0:1790773387.598657:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136832 00000100:00100000:3.0:1790773387.598668:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136960 00000100:00100000:3.0:1790773387.598670:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136960 00000100:00100000:3.0:1790773387.598682:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136704 00000100:00100000:3.0:1790773387.598684:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136704 00000100:00100000:2.0:1790773387.598687:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496136448:12345-0@lo:400:kworker.0 Request processed in 34us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773387.598693:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790773387.598695:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790773387.598700:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496137088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.598708:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773387.598728:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496137088:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773387.598745:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496136448:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598748:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790773387.598754:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496137088:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598760:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137216 00000100:00100000:3.0:1790773387.598763:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137216 00000100:00100000:3.0:1790773387.598778:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790773387.598784:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496136320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598828:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496136320:12345-0@lo:400:kworker.0 Request processed in 44us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.598834:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790773387.598855:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790773387.598861:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598896:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ff26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496136832:12345-0@lo:400:kworker.0 Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.598903:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790773387.598903:0:19203:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136576 00000100:00100000:0.0:1790773387.598906:0:19203:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136576 00000100:00100000:3.0:1790773387.598916:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790773387.598922:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496136960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.598954:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496136960:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.598960:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790773387.598972:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790773387.598977:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496136704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773387.598990:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790773387.598997:0:19203:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496136576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.599007:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496136704:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.599012:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790773387.599023:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790773387.599025:0:19203:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496136576:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.599029:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496137216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773387.599031:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773387.599053:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1877761496137216:12345-0@lo:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.599058:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790773387.599079:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496136704:0@lo:400:kworker.0 00000100:00100000:0.0:1790773387.599081:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496136064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790773387.599095:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773387.599098:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790773387.599099:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447ddc00 x1877761496136960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773387.599101:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773387.599110:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496136960:0@lo:400:kworker.0 00000100:00100000:3.0:1790773387.599133:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496136576:0@lo:400:kworker.0 00010000:00080000:2.0:1790773387.599443:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447df480 x1877761496137216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773387.599454:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3605:1877761496137216:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.599464:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496136320:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.599473:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496136832:0@lo:400:kworker.0 00000100:00100000:1.0:1790773387.599585:0:17116:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496136192 00000100:00100000:1.0:1790773387.599590:0:17116:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496136192 00000100:00100000:1.0:1790773387.599640:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1790773387.599648:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3604:x1877761496136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773387.599699:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3604:x1877761496136192:12345-0@lo:400:kworker.0 Request processed in 52us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773387.599705:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1790773387.600027:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496136192:0@lo:400:kworker.0 00000100:00100000:2.0:1790773387.825966:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773387.826075:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773387.826113:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773387.826784:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535168 00000100:00100000:3.0:1790773387.826795:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535168 00000100:00100000:3.0:1790773387.826882:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535040 00000100:00100000:3.0:1790773387.826886:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535040 00000100:00100000:3.0:1790773387.826913:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1790773387.826923:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2397:x1877761484535168:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773387.827003:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2397:x1877761484535168:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.827011:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1790773387.827028:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1790773387.827034:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2397:x1877761484535040:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773387.827060:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2397:x1877761484535040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773387.827066:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00080000:2.0:1790773387.827517:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773387.827522:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773387.828571:0:17117:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484534912 00000100:00100000:1.0:1790773387.828585:0:17117:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484534912 00000100:00100000:1.0:1790773387.828684:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:1.0:1790773387.828693:0:17117:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:2397:x1877761484534912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773387.828772:0:17117:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:2397:x1877761484534912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773387.828780:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000001:00100000:0.0:1790773388.113949:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000020:00000080:0.0:1790773388.113959:0:18624:0:(genops.c:885:class_export_put()) final put ffff93d27ff70800/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:0.0:1790773388.113984:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000020:00000080:0.0:1790773388.113986:0:18624:0:(genops.c:885:class_export_put()) final put ffff93d14338a800/332c789e-f22c-433e-a652-7f15822046a7 00000020:00000080:3.0:1790773388.114037:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27ff70800/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 for lustre-OST0000 00000020:00000080:3.0:1790773388.114091:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14338a800/332c789e-f22c-433e-a652-7f15822046a7 for lustre-OST0000 00000020:00000080:3.0:1790773388.114109:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27ff73800 for lustre-OST0000 00000020:00000080:3.0:1790773388.114113:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14338b800 for lustre-OST0000 00000001:00100000:0.0:1790773388.115490:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000020:00000080:0.0:1790773388.115498:0:19441:0:(genops.c:885:class_export_put()) final put ffff93d143388000/332c789e-f22c-433e-a652-7f15822046a7 00000001:00100000:0.0:1790773388.115520:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000020:00000080:0.0:1790773388.115523:0:19441:0:(genops.c:885:class_export_put()) final put ffff93d24402c800/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000020:00000080:1.0:1790773388.115618:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143388000/332c789e-f22c-433e-a652-7f15822046a7 for lustre-OST0001 00000020:00000080:1.0:1790773388.115661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d24402c800/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 for lustre-OST0001 00000020:00000080:1.0:1790773388.115676:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14338f000 for lustre-OST0001 00000020:00000080:1.0:1790773388.115680:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d24402e800 for lustre-OST0001 00000100:00100000:2.0:1790773388.134017:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773388.134064:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773388.134240:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773388.142073:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535296 00000100:00100000:0.0:1790773388.142092:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535296 00000100:00100000:0.0:1790773388.142436:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535552 00000100:00100000:0.0:1790773388.142442:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535552 00000100:00100000:3.0:1790773388.142497:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535424 00000100:00100000:3.0:1790773388.142501:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535424 00000100:00100000:2.0:1790773388.142605:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1790773388.142620:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+12:2399:x1877761484535296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773388.142638:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773388.142658:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a2200/0xabf1cc0bc7842f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bff3 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773388.142676:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773388.142755:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+11:2399:x1877761484535296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 140us (8748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773388.142763:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1790773388.142782:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773388.142789:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+10:2399:x1877761484535552:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773388.142796:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773388.142805:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3400/0xabf1cc0bc7842fd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c063 expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773388.142814:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773388.142832:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+9:2399:x1877761484535552:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 44us (8767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773388.142847:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1790773388.142860:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1790773388.142866:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+8:2399:x1877761484535424:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773388.142890:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773388.142900:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc7842f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c024 expref: 8 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773388.142908:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773388.142929:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+7:2399:x1877761484535424:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 63us (8690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773388.142934:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1790773388.150572:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773388.150708:0:17123:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535808 00000100:00100000:3.0:1790773388.150720:0:17123:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535808 00000100:00100000:3.0:1790773388.150781:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1790773388.150791:0:17123:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+6:2396:x1877761484535808:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:3.0:1790773388.151024:0:17123:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842fa1 00000020:00010000:3.0:1790773388.151034:0:17123:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d143291000: total 0 00000100:00080000:3.0:1790773388.151039:0:17123:0:(import.c:65:import_set_state_nolock()) ffff93d143290000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790773388.151070:0:17123:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1790773388.151292:0:20149:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d143291000: total 0 00010000:00010000:1.0:1790773388.151355:0:20149:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d143291000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790773388.151392:0:20149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff73500) 00010000:00010000:1.0:1790773388.151396:0:20149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790773388.151405:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843096 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c08d expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773388.151443:0:20149:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d143291000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790773388.151456:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773388.151459:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773388.151460:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773388.151829:0:17123:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+3:2396:x1877761484535808:12345-192.168.202.19@tcp:39:umount.0 Request processed in 1037us (1265us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1790773388.151850:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1790773388.170998:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773388.171479:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484535936 00000100:00100000:0.0:1790773388.171492:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484535936 00000100:00100000:0.0:1790773388.171573:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1790773388.171585:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+5:2396:x1877761484535936:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:0.0:1790773388.171630:0:17124:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842fa8 00000100:00080000:0.0:1790773388.171641:0:17124:0:(import.c:65:import_set_state_nolock()) ffff93d27ff72800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773388.171674:0:17124:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1790773388.171850:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc5bed67-af2d-4aff-9e99-0fd42cc26e20+3:2396:x1877761484535936:12345-192.168.202.19@tcp:39:umount.0 Request processed in 266us (861us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790773388.171858:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00010000:00010000:3.0:1790773388.172007:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773388.217076:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773388.217278:0:17115:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536192 00000100:00100000:2.0:1790773388.217289:0:17115:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536192 00000100:00100000:1.0:1790773388.217443:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:1.0:1790773388.217460:0:17116:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+7:2396:x1877761484536192:12345-192.168.202.19@tcp:251:umount.0 00000020:00000080:1.0:1790773388.217511:0:17116:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842f3f 00000020:00010000:1.0:1790773388.217518:0:17116:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d141c43000: total 0 00000100:00080000:1.0:1790773388.217523:0:17116:0:(import.c:65:import_set_state_nolock()) ffff93d141c44800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790773388.217611:0:17116:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5+3:2396:x1877761484536192:12345-192.168.202.19@tcp:251:umount.0 Request processed in 154us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773388.217619:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000020:00010000:0.0:1790773388.217827:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d141c43000: total 0 00010000:00010000:0.0:1790773388.217902:0:17111:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d141c43000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1790773388.217938:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b600/0xabf1cc0bc7842f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6bf7c expref: 2 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773388.217954:0:17111:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d141c43000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1790773388.217965:0:17111:0:(genops.c:885:class_export_put()) final put ffff93d141c43000/1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5 00010000:00010000:0.0:1790773388.217988:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773388.217990:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773388.217992:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790773388.218778:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c43000/1ba2d4a4-e48a-4b7a-9df9-3e69e2d893f5 for MGS 00000020:00000080:1.0:1790773388.218818:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141c44800 for MGS 00010000:00010000:1.0:1790773388.493570:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773389.075073:0:17158:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790773389.075082:0:17158:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773389.075104:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790773389.075112:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1790773389.517384:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773390.187559:0:20693:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790773390.200356:0:20693:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1790773390.200413:0:20693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.200444:0:20693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.200451:0:20693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.200456:0:20693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.200475:0:20693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790773390.200480:0:20693:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790773390.200506:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773390.200510:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790773390.200515:0:20693:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790773390.200540:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d26c380000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790773390.200606:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496137344:0@lo:39:umount.0 00000100:00100000:2.0:1790773390.200675:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773390.200754:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137344 00000100:00100000:0.0:1790773390.200762:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137344 00000100:00100000:0.0:1790773390.200827:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790773390.200839:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3603:x1877761496137344:12345-0@lo:39:umount.0 00000020:00000080:0.0:1790773390.200870:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b33 00000100:00080000:0.0:1790773390.200879:0:17122:0:(import.c:65:import_set_state_nolock()) ffff93d26c387000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1790773390.200944:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3603:x1877761496137344:12345-0@lo:39:umount.0 Request processed in 106us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773390.200952:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1790773390.200962:0:17122:0:(genops.c:885:class_export_put()) final put ffff93d26c382000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1790773390.201043:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26c380000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790773390.201059:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496137344:0@lo:39:umount.0 00000100:00080000:0.0:1790773390.201108:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773390.201111:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790773390.201122:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790773390.202033:0:20693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202050:0:20693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202057:0:20693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202065:0:20693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202084:0:20693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790773390.202091:0:20693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202098:0:20693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202104:0:20693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202110:0:20693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202117:0:20693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790773390.202124:0:20693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202131:0:20693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202149:0:20693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202154:0:20693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202162:0:20693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1790773390.202168:0:20693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202175:0:20693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202181:0:20693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202187:0:20693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773390.202196:0:20693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1790773390.202199:0:20693:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1790773390.202250:0:20693:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1790773390.202255:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1790773390.202259:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773390.202264:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:0.0:1790773390.202269:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d141c46000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773390.202274:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d14328b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773390.202278:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d26eed6800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773390.202288:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93d143286000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773390.202294:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93d143291000 cc5bed67-af2d-4aff-9e99-0fd42cc26e20 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1790773390.202300:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93d141c41000 332c789e-f22c-433e-a652-7f15822046a7 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934626 stale:0 00000020:00080000:0.0:1790773390.202305:0:20693:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93d281bacd40) has exports, disconnecting them 00000020:00080000:0.0:1790773390.202309:0:20693:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d141c46000), last request at 1790773387 00000020:00000080:0.0:1790773390.202315:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d6a 00000100:00080000:0.0:1790773390.202332:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d141c45800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790773390.202383:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d141c46000): rc 0 00000020:00000080:0.0:1790773390.202386:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d141c46000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1790773390.202393:0:20693:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d14328b800), last request at 1790773387 00000020:00000080:0.0:1790773390.202396:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842cd0 00000100:00080000:0.0:1790773390.202402:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d14328c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790773390.202408:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d14328b800): rc 0 00000020:00000080:0.0:1790773390.202409:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d14328b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1790773390.202413:0:20693:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d26eed6800), last request at 1790773320 00000020:00000080:0.0:1790773390.202416:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842c21 00000100:00080000:0.0:1790773390.202419:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d26eed2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1790773390.202424:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26eed6800): rc 0 00000020:00000080:0.0:1790773390.202426:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26eed6800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1790773390.202429:0:20693:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d143286000), last request at 1790773320 00000020:00000080:0.0:1790773390.202432:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842bb8 00000100:00080000:0.0:1790773390.202435:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d281bd4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773390.202440:0:20693:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1790773390.202519:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d143286000): rc 0 00000004:00000080:0.0:1790773390.202527:0:20693:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb21f07943ae0 00000100:00080000:0.0:1790773390.202546:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773390.202555:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790773390.203376:0:20693:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790773390.203402:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1790773390.203595:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790773390.203604:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203613:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ade00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773390.203617:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203627:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773390.203634:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773390.203650:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773390.203652:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1790773390.203655:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1790773390.203681:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203688:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773390.203707:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203714:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ade00/0xabf1cc0bc7842b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b09 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203727:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790773390.203731:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203736:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26efc5a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773390.203739:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203746:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773390.203751:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773390.203755:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773390.203757:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1790773390.203764:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1790773390.203779:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203785:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773390.203798:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203805:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26efc5a00/0xabf1cc0bc7842a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a5a expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203815:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790773390.203828:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203834:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074a600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773390.203836:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203843:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773390.203849:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773390.203854:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773390.203856:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1790773390.203858:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1790773390.203869:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203874:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773390.203887:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203893:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074a600/0xabf1cc0bc7842f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f38 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203902:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773390.203906:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203912:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fe00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773390.203915:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203921:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773390.203926:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773390.203930:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1790773390.203932:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1790773390.203933:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1790773390.203946:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203952:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773390.203957:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203964:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166fe00/0xabf1cc0bc784300a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843011 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203984:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773390.203987:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.203992:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773390.203994:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204001:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773390.204007:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773390.204012:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1790773390.204013:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1790773390.204015:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1790773390.204028:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204033:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773390.204038:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204043:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b600/0xabf1cc0bc7842a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842a4c expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204050:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773390.204052:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773390.204059:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773390.204077:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496137600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.204147:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.204195:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496138112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.204254:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.204285:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773390.204292:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496137984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.204313:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.204336:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496137728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.204358:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.204375:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773390.204379:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496137856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.204394:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.204413:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137600 00000100:00100000:1.0:1790773390.204420:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137600 00000100:00100000:1.0:1790773390.204455:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138112 00000100:00100000:1.0:1790773390.204457:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138112 00000100:00100000:1.0:1790773390.204465:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137984 00000100:00100000:1.0:1790773390.204467:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137984 00000100:00100000:1.0:1790773390.204475:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137728 00000100:00100000:1.0:1790773390.204477:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137728 00000100:00100000:1.0:1790773390.204485:0:20148:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137856 00000100:00100000:1.0:1790773390.204487:0:20148:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137856 00000100:00100000:1.0:1790773390.204499:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773390.204506:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+28:3605:x1877761496137600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.204519:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773390.204534:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4e00/0xabf1cc0bc7842b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842b02 expref: 28 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204559:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773390.204593:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+27:3605:x1877761496137600:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773390.204601:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773390.204619:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773390.204624:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+26:3605:x1877761496138112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.204632:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773390.204639:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4800/0xabf1cc0bc7842a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842a45 expref: 26 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204648:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773390.204665:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+25:3605:x1877761496138112:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773390.204670:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773390.204679:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773390.204684:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+24:3605:x1877761496137984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.204689:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773390.204696:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166fc00/0xabf1cc0bc7843011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc784300a expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204703:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773390.204718:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+23:3605:x1877761496137984:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773390.204723:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773390.204733:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773390.204737:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+22:3606:x1877761496137728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.204748:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773390.204755:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc5200/0xabf1cc0bc7842a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842a53 expref: 22 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.204762:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773390.204783:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+21:3606:x1877761496137728:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773390.204788:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790773390.204881:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773390.204973:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496137472:0@lo:39:umount.0 00000100:00100000:2.0:1790773390.205008:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773390.205039:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496137472 00000100:00100000:2.0:1790773390.205044:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496137472 00000100:00100000:2.0:1790773390.205070:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773390.205075:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496137472:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790773390.205100:0:17127:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842c4b 00000100:00080000:2.0:1790773390.205107:0:17127:0:(import.c:65:import_set_state_nolock()) ffff93d280f76000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790773390.205126:0:17127:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790773390.205261:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3603:x1877761496137472:12345-0@lo:39:umount.0 Request processed in 185us (251us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1790773390.205268:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1790773390.205305:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251285800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790773390.205313:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496137472:0@lo:39:umount.0 00010000:00010000:3.0:1790773390.205410:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790773390.205422:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26c382000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790773390.205475:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c46000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790773390.205499:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14328b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790773390.205523:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed6800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1790773390.205545:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26c387000 for lustre-MDT0000 00000020:00000080:3.0:1790773390.205549:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141c45800 for lustre-MDT0000 00000020:00000080:3.0:1790773390.205552:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14328c000 for lustre-MDT0000 00000020:00000080:3.0:1790773390.205555:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26eed2800 for lustre-MDT0000 00000100:00080000:0.0:1790773390.208998:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790773390.209010:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1790773390.209037:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790773390.209119:0:20693:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790773390.209154:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790773390.209183:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790773390.209185:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1790773390.209194:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790773390.209271:0:20693:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790773390.209279:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790773390.209326:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93d281bacd40) has no exports 00000100:00100000:1.0:1790773390.209422:0:20148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773390.209445:0:20148:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+20:3606:x1877761496137856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.209464:0:20148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773390.209489:0:20148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3800/0xabf1cc0bc7842f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842f31 expref: 20 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773390.209509:0:20148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773390.209589:0:20148:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdd0c180-4c21-4c72-90c1-0147a5902c2f+19:3606:x1877761496137856:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (5192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773390.209788:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496138240:0@lo:9:umount.0 00000100:00100000:2.0:1790773390.209846:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773390.209913:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496138368:0@lo:9:umount.0 00000100:00100000:2.0:1790773390.209935:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773390.209962:0:20148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773390.210022:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496137984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.210034:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496137600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.210043:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496138112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.210074:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496137856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773390.210084:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496137728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773390.210101:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773390.212095:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138240 00000100:00100000:3.0:1790773390.212107:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138240 00000100:00100000:3.0:1790773390.212231:0:18629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138368 00000100:00100000:3.0:1790773390.212235:0:18629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138368 00000100:00100000:1.0:1790773390.212285:0:19515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773390.212297:0:19515:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496138240:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790773390.212327:0:19515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d8d 00000100:00080000:1.0:1790773390.212336:0:19515:0:(import.c:65:import_set_state_nolock()) ffff93d14316f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790773390.212374:0:19515:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1790773390.212540:0:19515:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3603:x1877761496138240:12345-0@lo:9:umount.0 Request processed in 246us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773390.212548:0:19515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1790773390.212609:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790773390.212614:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790773390.212623:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773390.212654:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d251282000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790773390.212674:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790773390.212677:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773390.212680:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496138240:0@lo:9:umount.0 00000100:00100000:3.0:1790773390.212838:0:18629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773390.212846:0:18629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3603:x1877761496138368:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790773390.212861:0:18629:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d94 00000100:00080000:3.0:1790773390.212866:0:18629:0:(import.c:65:import_set_state_nolock()) ffff93d143cd9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790773390.212902:0:18629:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:2.0:1790773390.213005:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773390.213127:0:18629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3603:x1877761496138368:12345-0@lo:9:umount.0 Request processed in 281us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773390.213145:0:18629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790773390.213198:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143276000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790773390.213223:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790773390.213225:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773390.213228:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496138368:0@lo:9:umount.0 00000020:00080000:3.0:1790773390.219788:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93d281bacd40) has no exports 00000020:00000080:3.0:1790773390.261758:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842aa0 00000020:00000080:3.0:1790773390.261779:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d251286800/lustre-QMT0000_UUID 00000020:01000000:3.0:1790773390.261867:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790773390.262017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251286800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790773390.262046:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773390.262057:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790773390.262062:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff93d141d819c0) has no exports 00000020:00000080:2.0:1790773390.262502:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a99 00000020:00000080:2.0:1790773390.262508:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26ed8b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790773390.262613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790773390.262674:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773390.262695:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790773390.262697:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26ed8a000/lustre-QMT0000_UUID 00000020:00000080:2.0:1790773390.262700:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790773390.262704:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1790773390.543001:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790773391.184417:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790773391.184433:0:17855:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1790773391.184438:0:17855:0:(genops.c:885:class_export_put()) final put ffff93d27f91f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1790773391.184454:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00080000:0.0:1790773391.184460:0:17855:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1790773391.184462:0:17855:0:(genops.c:885:class_export_put()) final put ffff93d143294000/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00100000:0.0:1790773391.184466:0:17855:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:00080000:0.0:1790773391.184469:0:17855:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1790773391.184470:0:17855:0:(genops.c:885:class_export_put()) final put ffff93d141c43800/332c789e-f22c-433e-a652-7f15822046a7 00000100:00100000:2.0:1790773391.185035:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773391.185055:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496138496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773391.185131:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773391.185178:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138496 00000100:00100000:2.0:1790773391.185185:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138496 00000100:00100000:2.0:1790773391.185276:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773391.185287:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496138496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773391.185318:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773391.185364:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496138496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773391.185371:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1790773391.185391:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773391.185425:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496138496:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1790773391.186191:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773391.186198:0:17102:0:(genops.c:885:class_export_put()) final put ffff93d143286000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790773391.186383:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27f91f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:0.0:1790773391.186631:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000001:00080000:0.0:1790773391.186641:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1790773391.186644:0:17102:0:(genops.c:885:class_export_put()) final put ffff93d143291000/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 00000020:00000080:1.0:1790773391.186955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143294000/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 for lustre-MDT0001 00000020:00000080:1.0:1790773391.186993:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c43800/332c789e-f22c-433e-a652-7f15822046a7 for lustre-MDT0001 00000020:00000080:1.0:1790773391.187026:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d280f76000 for lustre-MDT0001 00000020:00000080:1.0:1790773391.187032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143286000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1790773391.187053:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27ff72800 for lustre-MDT0001 00000020:00000080:1.0:1790773391.187057:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141c42000 for lustre-MDT0001 00000020:00000080:1.0:1790773391.187060:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d281bd4000 for lustre-MDT0000 00000001:00100000:0.0:1790773391.187129:0:17102:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 332c789e-f22c-433e-a652-7f15822046a7 00000001:00080000:0.0:1790773391.187135:0:17102:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1790773391.187138:0:17102:0:(genops.c:885:class_export_put()) final put ffff93d141c41000/332c789e-f22c-433e-a652-7f15822046a7 00000020:00000080:1.0:1790773391.187349:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143291000/cc5bed67-af2d-4aff-9e99-0fd42cc26e20 for lustre-MDT0000 00000020:00000080:1.0:1790773391.187377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c41000/332c789e-f22c-433e-a652-7f15822046a7 for lustre-MDT0000 00000020:00000080:1.0:1790773391.187400:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143290000 for lustre-MDT0000 00000020:00000080:1.0:1790773391.187404:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141c40800 for lustre-MDT0000 00010000:00010000:2.0:1790773391.566344:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773392.205676:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496138624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773392.205758:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773392.205881:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138624 00000100:00100000:2.0:1790773392.205891:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138624 00000100:00100000:2.0:1790773392.205948:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790773392.205956:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3607:x1877761496138624:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1790773392.205964:0:17127:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790773392.206027:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3607:x1877761496138624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (268us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773392.206034:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:02020000:1.0:1790773392.206124:0:3607:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1790773392.213694:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790773392.213704:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790773392.213709:0:3607:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790773392.240844:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773392.240891:0:3607:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1790773392.240910:0:3607:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d281bd5000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773392.240957:0:3607:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d280f6ed80 x1877761496138752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773392.241576:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496138752:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1790773392.241651:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.241707:0:17127:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496138752 00000100:00100000:0.0:1790773392.241717:0:17127:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496138752 00000100:00100000:0.0:1790773392.241763:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790773392.241771:0:17127:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496138752:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1790773392.241788:0:17127:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790773392.255059:0:17127:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496138752:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 13275us (13395us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773392.255079:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1790773392.255548:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773392.255557:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790773392.255563:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496138752:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1790773392.269430:0:20693:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d26ecedea0 - data ffff93d273ae56c0/ffff93d142586c00 00000020:01000000:2.0:1790773392.269757:0:20693:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d141d99de0 - data ffff93d1420146c0/ffff93d27df88c00 00000001:00000004:2.0:1790773392.279385:0:20693:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000040:00080000:0.0:1790773392.334448:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1790773392.343984:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790773392.343994:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790773392.344010:0:20693:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff93d1437df480 x1877761496137472/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790773400 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773392.344038:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790773392.345128:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790773392.345133:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1790773392.345149:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773392.345151:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790773392.346320:0:17146:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790773392.346327:0:17146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1790773392.346336:0:17146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1790773392.347079:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790773392.347086:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1790773392.347111:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773392.347115:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790773392.347618:0:17148:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790773392.347622:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1790773392.347630:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790773392.349192:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a68 00000020:00000080:2.0:1790773392.349240:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d2496d1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790773392.351040:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a7d 00000020:00000080:2.0:1790773392.351054:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26c2b0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790773392.351062:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790773392.351067:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773392.351075:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790773392.351079:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93d281ba8000) has no exports 00000004:01000000:2.0:1790773392.351352:0:20693:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790773392.351361:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842adf 00000020:00000080:2.0:1790773392.351365:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d143275800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790773392.351370:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790773392.351373:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773392.351378:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773392.351380:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff93d14273cd40) has no exports 00000020:00000080:2.0:1790773392.351386:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842ad8 00000020:00000080:2.0:1790773392.351388:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d143274800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1790773392.352014:0:20693:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790773392.352020:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790773392.352024:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1790773392.352029:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773392.352032:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790773392.352061:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773392.352068:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790773392.352072:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842aca 00000020:00000080:2.0:1790773392.352078:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d143277000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790773392.352081:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790773392.352085:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773392.352088:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773392.352091:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93d141d80000) has no exports 00000020:00000080:2.0:1790773392.352096:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842ac3 00000020:00000080:2.0:1790773392.352098:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d251282800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773392.352363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2496d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773392.352374:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26c2b0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1790773392.352379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143275800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790773392.352383:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143274800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773392.352387:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143276000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790773392.352392:0:8:0:(genops.c:885:class_export_put()) final put ffff93d143270800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773392.352395:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143270800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790773392.352399:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773392.352486:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143277000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790773392.352499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251282800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790773392.353000:0:20693:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790773392.353004:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790773392.353007:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1790773392.353012:0:20693:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773392.353014:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790773392.353056:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773392.353063:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1790773392.353074:0:20693:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790773392.353079:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842ab5 00000020:00000080:2.0:1790773392.353084:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26ed88800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790773392.353089:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1790773392.353093:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773392.353097:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773392.353100:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff93d142738000) has no exports 00000020:00000080:2.0:1790773392.353106:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842aae 00000020:00000080:2.0:1790773392.353109:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d251287800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773392.356594:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d251282000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790773392.356611:0:8:0:(genops.c:885:class_export_put()) final put ffff93d26ed8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773392.356616:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790773392.356626:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773392.356711:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed88800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1790773392.356717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251287800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1790773392.370284:0:20693:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1790773392.370297:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773392.370302:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773392.370311:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773392.370657:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773392.370670:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773392.370697:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773392.370701:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773392.370706:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d2496d0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773392.370711:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2496d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1790773392.370719:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790773392.370850:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a84 00000020:00000080:0.0:1790773392.370859:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26c2b5800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790773392.371118:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d251285800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790773392.371127:0:8:0:(genops.c:885:class_export_put()) final put ffff93d251286000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790773392.371129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251286000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790773392.371139:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1790773392.371724:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1790773392.371759:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773392.371778:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790773392.371784:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93d281bab380) has no exports 00000020:00000080:0.0:1790773392.371815:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773392.371820:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1790773392.371826:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a8b 00000020:00000080:0.0:1790773392.371833:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26c2b0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790773392.372403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26c2b5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790773392.372413:0:8:0:(genops.c:885:class_export_put()) final put ffff93d245fc4800/lustre-MDD0000_UUID 00000020:00000080:1.0:1790773392.372416:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d245fc4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790773392.372422:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1790773392.379117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26c2b0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1790773392.379153:0:20693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14444c000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790773392.379158:0:20693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14444c000 3 00000020:01000004:1.0:1790773392.379162:0:20693:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d14444c000 from lustre-MDT0000 00000020:00000080:1.0:1790773392.379234:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773392.379247:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790773392.379252:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d2496d1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790773392.379256:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2496d1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790773392.379267:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790773392.379379:0:20693:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1790773392.379385:0:20693:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790773392.379389:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790773392.379393:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773392.379397:0:20693:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790773392.379405:0:20693:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93d1445ec800 cdd0c180-4c21-4c72-90c1-0147a5902c2f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773392.379412:0:20693:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93d1435e99c0) has exports, disconnecting them 00000020:00080000:1.0:1790773392.379417:0:20693:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93d1445ec800), last request at 1790773306 00000020:00000080:1.0:1790773392.379454:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a30 00000020:00010000:1.0:1790773392.379461:0:20693:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93d1445ec800: total 0 00000100:00080000:1.0:1790773392.379466:0:20693:0:(import.c:65:import_set_state_nolock()) ffff93d1445e9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790773392.379696:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d1445ec800): rc 0 00000020:00080000:1.0:1790773392.379703:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93d1435e99c0) has no exports 00000100:00100000:1.0:1790773392.379871:0:17117:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff93d2468ecc00:17117] 2 exiting: rc = 0 00000100:00100000:1.0:1790773392.379997:0:17116:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff93d2468ed000:17116] 1 exiting: rc = 0 00000020:00010000:0.0:1790773392.380106:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93d1445ec800: total 0 00010000:00010000:0.0:1790773392.380112:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773392.380156:0:17111:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d1445ec800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790773392.380189:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166ec00/0xabf1cc0bc7842ff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842fee expref: 14 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380238:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b400/0xabf1cc0bc7842b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842b64 expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380249:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074ac00/0xabf1cc0bc7842a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842a37 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380258:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b400/0xabf1cc0bc7842d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842d24 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380268:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074b000/0xabf1cc0bc7842cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842cb4 expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380279:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166e200/0xabf1cc0bc7842fe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842fe0 expref: 9 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380290:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a200/0xabf1cc0bc7842c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842c05 expref: 8 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380300:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074a400/0xabf1cc0bc7842b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842b56 expref: 7 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380313:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc7842d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842d4e expref: 6 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380322:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166e400/0xabf1cc0bc7843003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842ffc expref: 5 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380352:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d25074bc00/0xabf1cc0bc7842c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842c8a expref: 4 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380366:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc7842f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842f23 expref: 3 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380378:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26efc4400/0xabf1cc0bc7842b4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xabf1cc0bc7842b48 expref: 2 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773392.380389:0:17111:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d1445ec800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1790773392.380404:0:17111:0:(genops.c:885:class_export_put()) final put ffff93d1445ec800/cdd0c180-4c21-4c72-90c1-0147a5902c2f 00010000:00010000:0.0:1790773392.380418:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773392.380420:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773392.380421:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773392.380459:0:17115:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff93d2500b6800:17115] 0 exiting: rc = 1 00000020:00000080:1.0:1790773392.381338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1445ec800/cdd0c180-4c21-4c72-90c1-0147a5902c2f for MGS 00000020:00000080:1.0:1790773392.381371:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1445e9000 for MGS 00000100:00100000:1.0:1790773392.381418:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381425:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381430:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381437:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381445:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381451:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381457:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381464:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381751:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381760:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381775:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381782:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381788:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381795:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381810:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381815:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381820:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381827:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381832:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381837:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381843:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381848:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381854:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381859:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381875:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381880:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381886:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381892:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381897:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381902:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381907:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381912:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381917:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381923:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381928:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381933:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381938:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381945:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381950:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381956:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381961:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381966:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381970:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381976:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381981:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381986:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381991:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.381995:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382001:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382006:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382011:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382016:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382020:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382025:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382030:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382034:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382039:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382044:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382048:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382059:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382065:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382071:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382076:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773392.382081:0:20693:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1790773392.391761:0:20693:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d26eceda20 - data ffff93d2739a3438/ffff93d142587800 00000020:01000000:1.0:1790773392.391951:0:20693:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d2587640c0 - data ffff93d142042d80/ffff93d2813dd800 00000020:00000080:1.0:1790773392.392425:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a14 00000020:00000080:1.0:1790773392.392436:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d14444b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790773392.392453:0:20693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14444c000 from MGS, refs=2 00000020:01000004:1.0:1790773392.392456:0:20693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14444c000 2 00000020:01000004:1.0:1790773392.392459:0:20693:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d14444c000 from MGS 00000020:00000080:0.0:1790773392.392736:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14444b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790773392.393627:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773392.393638:0:20693:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790773392.393643:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d14444e800/MGS 00000020:00000080:1.0:1790773392.393646:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14444e800/MGS for MGS 00000020:01000000:1.0:1790773392.393654:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790773392.393740:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790773392.393745:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773392.393753:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790773392.393763:0:20693:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93d26c382800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790773392.393890:0:20693:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff93d14273b380) has exports, disconnecting them 00000020:00080000:1.0:1790773392.393897:0:20693:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93d26c382800), last request at 1790773306 00000020:00000080:1.0:1790773392.393902:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b17 00000020:00080000:1.0:1790773392.393919:0:20693:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26c382800): rc 0 00000020:00000080:1.0:1790773392.393924:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d26c382800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790773392.397402:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26c382800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790773392.400037:0:20693:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790773392.400046:0:20693:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773392.400051:0:20693:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773392.400059:0:20693:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773392.400096:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26c380000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790773392.400333:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773392.400343:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790773392.400349:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d2496d2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790773392.400353:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d2496d2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790773392.400360:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790773392.400456:0:20693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14444c000 1 00000020:00000080:0.0:1790773392.400473:0:20693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a06 00000020:00000080:0.0:1790773392.400488:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d14444e000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1790773392.400505:0:20693:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790773392.400514:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14444e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790773392.400522:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773392.400527:0:20693:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790773392.400531:0:20693:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93d1435eb380) has no exports 00000020:00000080:0.0:1790773392.442087:0:20693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773392.442104:0:20693:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1790773392.442112:0:20693:0:(genops.c:885:class_export_put()) final put ffff93d14444a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790773392.442117:0:20693:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14444a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790773392.442124:0:20693:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1790773392.442269:0:20693:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d14444f000 00000020:02000400:0.0:1790773392.442352:0:20693:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1790773392.598591:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773392.719285:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496139136:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719364:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.719413:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496139648:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719437:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.719462:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790773392.719467:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496139264:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719489:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.719506:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496139776:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719525:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.719564:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139136 00000100:00100000:0.0:1790773392.719573:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139136 00000100:00100000:0.0:1790773392.719631:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773392.719641:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496139136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719701:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496139136:12345-0@lo:400:kworker.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773392.719722:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790773392.719745:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139648 00000100:00100000:0.0:1790773392.719749:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139648 00000100:00100000:0.0:1790773392.719770:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139264 00000100:00100000:0.0:1790773392.719772:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139264 00000100:00100000:0.0:1790773392.719779:0:19912:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139776 00000100:00100000:0.0:1790773392.719781:0:19912:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139776 00000100:00100000:0.0:1790773392.719805:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790773392.719813:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.719844:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1877761496139776:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773392.719850:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790773392.719862:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773392.719865:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1877761496139648:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790773392.719871:0:19912:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790773392.719896:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1877761496139648:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790773392.719901:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773392.719914:0:19912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790773392.719917:0:19912:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1877761496139264:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790773392.719920:0:19912:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790773392.719939:0:19912:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3606:x1877761496139264:12345-0@lo:400:kworker.0 Request processed in 21us (450us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790773392.719943:0:19912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1790773392.719963:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773392.719968:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773392.719993:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790773392.719998:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d26eed7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790773392.720007:0:3606:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790773392.720012:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d26eed7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773392.720015:0:3606:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1790773392.720023:0:3606:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d26eed7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773392.720043:0:3606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e02680 x1877761496139904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773392.720063:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496139264:0@lo:400:kworker.0 00010000:00080000:0.0:1790773392.720076:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d281b9e680 x1877761496139776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773392.720086:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496139776:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.720095:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496139136:0@lo:400:kworker.0 00000100:00080000:0.0:1790773392.720102:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790773392.720105:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790773392.720108:0:3606:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790773392.720111:0:3606:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773392.720114:0:3606:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1790773392.720118:0:3606:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d280f72800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773392.720129:0:3606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e01180 x1877761496140032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773392.720138:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3606:1877761496139648:0@lo:400:kworker.0 00000100:00100000:0.0:1790773392.720165:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496139904:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790773392.720200:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.720238:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496140032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1790773392.720257:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773392.720280:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139904 00000100:00100000:0.0:1790773392.720284:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139904 00000100:00100000:0.0:1790773392.720299:0:17124:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140032 00000100:00100000:0.0:1790773392.720301:0:17124:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140032 00000100:00100000:0.0:1790773392.720312:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790773392.720316:0:17124:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496139904:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1790773392.720333:0:17124:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773392.720645:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496139008:0@lo:400:kworker.0 00000100:00100000:2.0:1790773392.720679:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773392.720700:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496139520:0@lo:400:kworker.0 00000100:00100000:2.0:1790773392.720720:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773392.720733:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790773392.720739:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496138880:0@lo:400:kworker.0 00000400:00000100:2.0:1790773392.720757:0:3605:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496138880 offset 0 length 224: 4 00000100:00100000:2.0:1790773392.720780:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496139392:0@lo:400:kworker.0 00000100:00100000:2.0:1790773392.720810:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773392.720947:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139520 00000100:00100000:2.0:1790773392.720952:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139520 00000100:00100000:2.0:1790773392.720985:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139392 00000100:00100000:2.0:1790773392.720988:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139392 00000100:00100000:2.0:1790773392.720997:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790773392.721003:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496139520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773392.721040:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496139520:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773392.721046:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790773392.721058:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790773392.721062:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496140032:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1790773392.721074:0:17122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773392.721097:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496140032:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (840us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773392.721102:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790773392.721113:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790773392.721116:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1877761496139392:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790773392.721130:0:17122:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790773392.721152:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1877761496139392:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773392.721158:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1790773392.721185:0:3605:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790773392.721189:0:3605:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1790773392.721193:0:3605:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1790773392.721196:0:3605:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773392.721199:0:3605:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 477 00000100:00080000:2.0:1790773392.721226:0:3605:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d143389000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773392.721243:0:3605:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c7b80 x1877761496140160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773392.721256:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496139392:0@lo:400:kworker.0 00010000:00080000:2.0:1790773392.721268:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff93d1437dc000 x1877761496139520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773392.721277:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496139520:0@lo:400:kworker.0 00000100:00080000:3.0:1790773392.721347:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773392.721454:0:19203:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496139008 00000100:00100000:1.0:1790773392.721459:0:19203:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496139008 00000100:00100000:1.0:1790773392.721481:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773392.721488:0:19203:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773392.721524:0:19203:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496139008:12345-0@lo:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773392.721537:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773392.721567:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496139008:0@lo:400:kworker.0 00000100:00100000:1.0:1790773392.721575:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773392.721583:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496140288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790773392.721608:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773392.721634:0:18632:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140288 00000100:00100000:1.0:1790773392.721637:0:18632:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140288 00000100:00100000:1.0:1790773392.721659:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773392.721665:0:18632:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496140288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773392.721686:0:18632:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790773392.721719:0:18632:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496140288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773392.721725:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773392.721756:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496140288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773392.736546:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496140160:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790773392.736639:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773392.736705:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773392.736710:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773392.736715:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496140032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1790773392.736808:0:17122:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140160 00000100:00100000:3.0:1790773392.736815:0:17122:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140160 00000100:00100000:3.0:1790773392.736859:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790773392.736866:0:17122:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496140160:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1790773392.736890:0:17122:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790773392.736942:0:17122:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496140160:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 74us (302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773392.736949:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1790773392.737057:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773392.737062:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790773392.737065:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496140160:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1790773392.743288:0:17124:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496139904:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 22958us (23075us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773392.743303:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790773392.743378:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26eed7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773392.743386:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790773392.743390:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496139904:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1790773393.613382:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773394.639567:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773395.661699:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773396.175664:0:20894:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790773396.191919:0:20894:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1790773396.191992:0:20894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.192007:0:20894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.192014:0:20894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.192021:0:20894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.192047:0:20894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790773396.192052:0:20894:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790773396.192078:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773396.192083:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790773396.192089:0:20894:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790773396.192094:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d26eed7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790773396.192099:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773396.192100:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790773396.192103:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790773396.193040:0:20894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193053:0:20894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193060:0:20894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193082:0:20894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193106:0:20894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790773396.193112:0:20894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193118:0:20894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193124:0:20894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193129:0:20894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193139:0:20894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790773396.193144:0:20894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193151:0:20894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193156:0:20894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193161:0:20894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193177:0:20894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1790773396.193182:0:20894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193188:0:20894:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193193:0:20894:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193198:0:20894:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.193228:0:20894:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1790773396.193232:0:20894:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1790773396.193265:0:20894:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1790773396.193269:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1790773396.193274:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773396.193280:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1790773396.193286:0:20894:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff93d14338b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790773396.193291:0:20894:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff93d1431fe000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790773396.193296:0:20894:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff93d279ea3380) has exports, disconnecting them 00000020:00080000:2.0:1790773396.193300:0:20894:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d14338b000), last request at 1790773392 00000020:00000080:2.0:1790773396.193307:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d7f 00000100:00080000:2.0:1790773396.193326:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d14338c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790773396.193379:0:20894:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d14338b000): rc 0 00000020:00000080:2.0:1790773396.193382:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d14338b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1790773396.193400:0:20894:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff93d1431fe000), last request at 1790773392 00000020:00000080:2.0:1790773396.193410:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842ce5 00000100:00080000:2.0:1790773396.193415:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d1431fd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790773396.193423:0:20894:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d1431fe000): rc 0 00000020:00000080:2.0:1790773396.193425:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d1431fe000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1790773396.193433:0:20894:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb21f018bfae0 00000100:00080000:2.0:1790773396.193451:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773396.193460:0:20894:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff93d2447ddc00 x1877761496138624/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790773408 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.193474:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790773396.194200:0:20894:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790773396.194225:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d281bd5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1790773396.194334:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790773396.194337:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1790773396.194344:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790773396.194429:0:20894:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790773396.194435:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790773396.194441:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790773396.194443:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1790773396.194447:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790773396.194494:0:20894:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790773396.194498:0:20894:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790773396.194528:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93d279ea3380) has no exports 00000100:00100000:2.0:1790773396.194657:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:0:1877761496140416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773396.194687:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496138624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790773396.194706:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790773396.194713:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.194735:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074be00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773396.194739:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.194748:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773396.194755:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195039:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790773396.195045:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195052:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773396.195055:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195069:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773396.195073:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773396.195077:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790773396.195079:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1790773396.195081:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1790773396.195110:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195114:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773396.195130:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195134:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac200/0xabf1cc0bc7842b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b6b expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195142:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790773396.195144:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195148:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d25074b200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773396.195149:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195154:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773396.195164:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773396.195168:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790773396.195169:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790773396.195170:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790773396.195178:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195181:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773396.195185:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195199:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074b200/0xabf1cc0bc7842f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842f2a expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195221:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773396.195224:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195227:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773396.195229:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195233:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773396.195237:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773396.195247:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790773396.195248:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790773396.195250:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790773396.195259:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195262:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773396.195269:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195273:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d24166f400/0xabf1cc0bc7842ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7843003 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195280:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773396.195281:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195284:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773396.195286:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195290:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773396.195293:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773396.195296:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790773396.195297:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790773396.195298:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790773396.195309:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195313:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773396.195316:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195321:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ad200/0xabf1cc0bc7842b56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842b5d expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773396.195329:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773396.195330:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773396.195331:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773396.195343:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496141056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773396.195405:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773396.195448:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773396.195462:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496141184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773396.195475:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773396.195526:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496140800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773396.195544:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773396.195563:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773396.195567:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496140928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773396.195587:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773396.195617:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496141056 00000100:00100000:3.0:1790773396.195624:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496141056 00000100:00100000:3.0:1790773396.195651:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496141184 00000100:00100000:3.0:1790773396.195653:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496141184 00000100:00100000:3.0:1790773396.195661:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140800 00000100:00100000:3.0:1790773396.195664:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140800 00000100:00100000:3.0:1790773396.195670:0:17108:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140928 00000100:00100000:3.0:1790773396.195679:0:17108:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140928 00000100:00100000:3.0:1790773396.195697:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773396.195704:0:17108:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3604:x1877761496141056:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790773396.195711:0:17108:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773396 with bad export cookie 12389908400836979248 00000100:00100000:1.0:1790773396.197219:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496140544:0@lo:9:umount.0 00000100:00100000:1.0:1790773396.197263:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773396.197295:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496140672:0@lo:9:umount.0 00000100:00100000:1.0:1790773396.197309:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790773396.198278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14338b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1790773396.198325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1431fe000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1790773396.198343:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14338c800 for lustre-MDT0001 00000020:00000080:0.0:1790773396.198347:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1431fd800 for lustre-MDT0001 00000100:00100000:0.0:1790773396.198362:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140544 00000100:00100000:0.0:1790773396.198371:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140544 00000100:00100000:0.0:1790773396.198415:0:18628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496140672 00000100:00100000:0.0:1790773396.198417:0:18628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496140672 00000100:00100000:0.0:1790773396.198432:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773396.198438:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3603:x1877761496140544:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790773396.198521:0:18628:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d0f 00000100:00080000:0.0:1790773396.198531:0:18628:0:(import.c:65:import_set_state_nolock()) ffff93d14328f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773396.198569:0:18628:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790773396.198715:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3603:x1877761496140544:12345-0@lo:9:umount.0 Request processed in 276us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773396.198732:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773396.198748:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773396.198755:0:18628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3603:x1877761496140672:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790773396.198776:0:18628:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d9b 00000100:00080000:0.0:1790773396.198783:0:18628:0:(import.c:65:import_set_state_nolock()) ffff93d14328e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790773396.199265:0:18628:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790773396.199334:0:18628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3603:x1877761496140672:12345-0@lo:9:umount.0 Request processed in 580us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773396.199340:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790773396.200374:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d27c378800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790773396.200381:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790773396.200383:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790773396.200386:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496140544:0@lo:9:umount.0 00000100:00080000:1.0:1790773396.200395:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bb7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790773396.200401:0:3603:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790773396.200402:0:3603:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790773396.200404:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496140672:0@lo:9:umount.0 10000000:01000000:2.0:1790773396.201550:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773396.201555:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790773396.201558:0:20149:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790773396.201599:0:20149:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.201607:0:20149:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773396.201630:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.201636:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d25074be00/0xabf1cc0bc7842c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xabf1cc0bc7842c0c expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773396.201648:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773396.201650:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773396.201652:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773396.201658:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773396.201886:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773396.201896:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3604:x1877761496141184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773396.201914:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773396 with bad export cookie 12389908400836979248 00000100:00100000:2.0:1790773396.201999:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3604:x1877761496141184:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (6520us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773396.202011:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773396.202031:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773396.202036:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1877761496140800:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773396.202040:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773396 with bad export cookie 12389908400836979248 00000100:00100000:2.0:1790773396.202066:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1877761496140800:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (6521us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773396.202071:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790773396.202082:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773396.202086:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1877761496140928:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773396.202090:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773396 with bad export cookie 12389908400836979248 00000100:00100000:2.0:1790773396.202113:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1877761496140928:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (6525us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773396.202118:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773396.202139:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773396.202153:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496141312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773396.202189:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1790773396.202793:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.202801:0:18624:0:(genops.c:885:class_export_put()) final put ffff93d143289800/lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1790773396.203666:0:17109:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496141312 00000100:00100000:2.0:1790773396.203679:0:17109:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496141312 00000100:00100000:2.0:1790773396.203727:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773396.203735:0:17109:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3607:x1877761496141312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790773396.203742:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790773396 with bad export cookie 12389908400836979248 00000100:00100000:2.0:1790773396.203964:0:17109:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3607:x1877761496141312:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (1772us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790773396.203993:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1790773396.204044:0:3607:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790773396.204051:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790773396.204055:0:3607:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000001:00100000:0.0:1790773396.204523:0:18624:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773396.204530:0:18624:0:(genops.c:885:class_export_put()) final put ffff93d143280000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773396.204557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143289800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790773396.204591:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143280000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:1.0:1790773396.204600:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790773396.204605:0:19441:0:(genops.c:885:class_export_put()) final put ffff93d143289000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.204608:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14328f000 for lustre-OST0000 00000020:00000080:0.0:1790773396.204613:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14316f000 for lustre-OST0000 00000001:00100000:1.0:1790773396.204614:0:19441:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790773396.204616:0:19441:0:(genops.c:885:class_export_put()) final put ffff93d143cda800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790773396.204617:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143289000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790773396.204629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143cda800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1790773396.204642:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d14328e800 for lustre-OST0001 00000020:00000080:0.0:1790773396.205059:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143cd9800 for lustre-OST0001 00000100:00080000:0.0:1790773396.205592:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773396.205597:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773396.205644:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1790773396.206852:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773396.212230:0:3607:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.119@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790773396.212237:0:3607:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790773396.212247:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1437dca80 x1877761496138880/t0(0) o400->MGC192.168.202.119@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790773408 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.212262:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447de680 x1877761496141056/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773412 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.212271:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447dce00 x1877761496141184/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773412 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.212280:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447ded80 x1877761496140800/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773412 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.212288:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447ddf80 x1877761496140928/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773412 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773396.212297:0:3607:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1444c5c00 x1877761496141312/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790773412 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790773396.212317:0:3607:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790773396.212320:0:3607:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790773396.212321:0:3607:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1790773396.212540:0:3606:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff93d26ec39000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790773396.212570:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496140800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773396.212626:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3606:1877761496140928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773396.212800:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496141184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773396.212809:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3604:1877761496141056:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1790773396.214993:0:17108:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1877761496141056 offset 224 length 224: 4 00000100:00100000:3.0:1790773396.215026:0:17108:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3604:x1877761496141056:12345-0@lo:103:ldlm_bl.0 Request processed in 19318us (19616us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790773396.215040:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1790773396.215558:0:3607:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773396.215569:0:3607:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 449 00000100:00080000:2.0:1790773396.215587:0:3607:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d26ec39000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773396.215620:0:3607:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c4e00 x1877761496141440/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773396.215659:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3607:1877761496141312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773396.215731:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3605:1877761496138880:0@lo:400:kworker.0 00000100:00100000:0.0:1790773396.215871:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496141440:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1790773396.215955:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496141440 offset 0 length 520: 4 00000020:00080000:2.0:1790773396.220199:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93d279ea3380) has no exports 00000020:01000000:0.0:1790773396.307583:0:20894:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d26eced540 - data ffff93d1420145e8/ffff93d142585800 00000020:01000000:0.0:1790773396.307775:0:20894:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d258764d20 - data ffff93d2739a1000/ffff93d280ea4c00 00000001:00000004:0.0:1790773396.322849:0:20894:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1790773396.424155:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773396.424164:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790773396.424173:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790773396.431516:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790773396.431527:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1790773396.431548:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773396.431551:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790773396.432094:0:17863:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790773396.432099:0:17863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1790773396.432114:0:17863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1790773396.432755:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790773396.432770:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1790773396.432790:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773396.432792:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790773396.433222:0:17865:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790773396.433227:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1790773396.433234:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790773396.436801:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b79 00000020:00000080:2.0:1790773396.436825:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb6800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790773396.437588:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b8e 00000020:00000080:2.0:1790773396.437596:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d245340000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790773396.437603:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1790773396.437611:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773396.437623:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790773396.437628:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93d141d83380) has no exports 00000004:01000000:2.0:1790773396.437837:0:20894:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790773396.437848:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842be2 00000020:00000080:2.0:1790773396.437853:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d27fa2c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790773396.437858:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790773396.437862:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773396.437867:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773396.437869:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff93d1435ecd40) has no exports 00000020:00000080:2.0:1790773396.437876:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842bdb 00000020:00000080:2.0:1790773396.437880:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790773396.438116:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790773396.438129:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d245340000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1790773396.438140:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27fa2c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790773396.438149:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1790773396.438359:0:20894:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790773396.438374:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790773396.438378:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1790773396.438384:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773396.438387:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790773396.441185:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773396.441255:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790773396.441267:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842bcd 00000020:00000080:2.0:1790773396.441276:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d26ed8e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.441336:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d281bb7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1790773396.441343:0:15123:0:(genops.c:885:class_export_put()) final put ffff93d27fa2d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.441347:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27fa2d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1790773396.441353:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1790773396.441474:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790773396.441479:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773396.441484:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773396.441488:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93d279ea4d40) has no exports 00000020:00000080:2.0:1790773396.441496:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842bc6 00000020:00000080:2.0:1790773396.441501:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d27c37d000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1790773396.441912:0:20894:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1790773396.441917:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790773396.441921:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1790773396.441927:0:20894:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790773396.441929:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790773396.441962:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773396.441967:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1790773396.441979:0:20894:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790773396.441985:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842bb1 00000020:00000080:2.0:1790773396.441990:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1790773396.441993:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1790773396.441997:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773396.441999:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773396.442002:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff93d1427399c0) has no exports 00000020:00000080:2.0:1790773396.442006:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842baa 00000020:00000080:2.0:1790773396.442008:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bd3800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1790773396.443334:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ed8e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790773396.443352:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27c37d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1790773396.443363:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d27c378800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1790773396.443371:0:15123:0:(genops.c:885:class_export_put()) final put ffff93d281bb1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.443374:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1790773396.443394:0:15123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773396.443476:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790773396.443481:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bd3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790773396.455306:0:20894:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1790773396.455317:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773396.455321:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773396.455330:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773396.455405:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773396.455442:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d281bd5000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1790773396.455479:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773396.455485:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d143271800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.455491:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143271800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1790773396.455507:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773396.455731:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773396.455735:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773396.455739:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790773396.455742:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790773396.455747:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773396.455855:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b95 00000020:00000080:0.0:1790773396.455870:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d245343800/lustre-MDD0001_UUID 00000020:01000000:0.0:1790773396.455884:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1790773396.455888:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773396.455912:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d245343800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1790773396.455940:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790773396.455944:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93d279ea0000) has no exports 00000020:00000080:0.0:1790773396.455968:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773396.455971:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1790773396.455974:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb2800/lustre-MDD0001_UUID 00000020:00000080:0.0:1790773396.455976:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb2800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1790773396.455979:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1790773396.456080:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b9c 00000020:00000080:0.0:1790773396.456096:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d245342000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1790773396.456113:0:20894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d27f91f800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1790773396.456116:0:20894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d27f91f800 2 00000020:01000004:0.0:1790773396.456120:0:20894:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d27f91f800 from lustre-MDT0001 00000020:00000080:0.0:1790773396.456143:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773396.456146:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1790773396.456148:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d281bb1000/lustre-MDT0001_UUID 00000020:00000080:0.0:1790773396.456150:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d281bb1000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1790773396.456157:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1790773396.456183:0:20894:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1790773396.456188:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1790773396.456191:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773396.456194:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773396.456202:0:20894:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff93d26eed2000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773396.456233:0:20894:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff93d27b2c0000) has exports, disconnecting them 00000020:00080000:0.0:1790773396.456239:0:20894:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff93d26eed2000), last request at 1790773320 00000020:00000080:0.0:1790773396.456243:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842c1a 00000020:00080000:0.0:1790773396.456255:0:20894:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d26eed2000): rc 0 00000020:00000080:0.0:1790773396.456259:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d26eed2000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790773396.456355:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d245342000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773396.456362:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26eed2000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1790773396.458255:0:20894:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1790773396.458264:0:20894:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773396.458268:0:20894:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790773396.458276:0:20894:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773396.458305:0:15123:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26eed7000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1790773396.458489:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773396.458509:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1790773396.458514:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d26ef92000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1790773396.458518:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef92000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1790773396.458524:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1790773396.458603:0:20894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d27f91f800 1 00000020:00000080:1.0:1790773396.458611:0:20894:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842b41 00000020:00000080:1.0:1790773396.458618:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d27fa2b800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1790773396.458626:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1790773396.458633:0:15123:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27fa2b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790773396.458642:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773396.458646:0:20894:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773396.458649:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff93d141d84d40) has no exports 00000020:00000080:1.0:1790773396.571772:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773396.571793:0:20894:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1790773396.571800:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d27f918000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1790773396.571806:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d27f918000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1790773396.571823:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1790773396.571975:0:20894:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d27f91e000 00000020:01000000:1.0:1790773396.571998:0:20894:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790773396.572004:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773396.572008:0:20894:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773396.572013:0:20894:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93d1435e8000) has no exports 00000100:00100000:2.0:1790773396.572400:0:17123:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff93d143769e00:17123] 1 exiting: rc = 0 00000100:00100000:2.0:1790773396.572535:0:19912:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff93d143486000:19912] 3 exiting: rc = 0 00000100:00100000:2.0:1790773396.574043:0:17122:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff93d143769600:17122] 0 exiting: rc = 1 00000100:00100000:0.0:1790773396.576281:0:17124:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff93d245f4c000:17124] 2 exiting: rc = 0 00000100:00100000:1.0:1790773396.587458:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587472:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587480:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587487:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587497:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587504:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587511:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587517:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587524:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587531:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587883:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587889:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587895:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587901:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587911:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587918:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587923:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587932:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587940:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587947:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587953:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587959:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587966:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587973:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587979:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587988:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.587995:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588000:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588005:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588010:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588015:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588021:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588026:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588032:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588038:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588044:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588050:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588055:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588061:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588066:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588071:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588079:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588086:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588092:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588099:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588118:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588125:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588136:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588142:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588149:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588159:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588165:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588171:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588177:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588182:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588188:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588194:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588201:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588246:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588252:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588258:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588264:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588269:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.588274:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.593854:0:17126:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93d26c3ca600:17126] 1 exiting: rc = 0 00000100:00100000:2.0:1790773396.593980:0:17125:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93d248d9ec00:17125] 0 exiting: rc = 1 00000100:00100000:1.0:1790773396.594172:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594184:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594193:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594200:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594230:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594236:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594241:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594247:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594252:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594258:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594264:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594270:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594275:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594281:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594287:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594292:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594313:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594319:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594325:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594330:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594335:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594340:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594345:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594351:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594356:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594362:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594369:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594375:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594381:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594386:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594392:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594398:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594403:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594409:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594414:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594420:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594426:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594432:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594438:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594445:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594451:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594457:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594462:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594468:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594474:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594480:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594486:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594491:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594498:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594504:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594509:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594525:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594531:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594537:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594550:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594558:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594565:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594571:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594576:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594582:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594588:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594594:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594600:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.594605:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.595144:0:17128:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff93d1434c2000:17128] 1 exiting: rc = 0 00000100:00100000:0.0:1790773396.600903:0:17127:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff93d1434c2c00:17127] 0 exiting: rc = 1 00000100:00100000:1.0:1790773396.601023:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601035:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601044:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601051:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601058:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601065:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601076:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601084:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601117:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601127:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601134:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601140:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601146:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601152:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601160:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601167:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601177:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601184:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601192:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601199:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601248:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601257:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601278:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601285:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601292:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601299:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601304:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601313:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601320:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601328:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601335:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601343:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601367:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601375:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601383:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601391:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601399:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601406:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601413:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601419:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601426:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601434:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601442:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601449:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601471:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601481:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601488:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601495:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601504:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601511:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601518:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601525:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601535:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601541:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601549:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601556:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601582:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601596:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601601:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601607:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601614:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601620:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601626:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773396.601633:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620099:0:17129:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93d1434c2a00:17129] 0 exiting: rc = 1 00000100:00100000:3.0:1790773396.620520:0:17130:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93d1434c3a00:17130] 1 exiting: rc = 0 00000100:00100000:2.0:1790773396.620678:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620685:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620690:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620696:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620702:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620707:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620725:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620731:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620737:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620743:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620748:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620755:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620771:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620777:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620782:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620787:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620793:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620798:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620804:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620810:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620817:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620822:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620828:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620834:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620840:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620845:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620850:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620855:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620860:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620883:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620888:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620893:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620898:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620903:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620909:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620915:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620919:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620924:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620929:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620933:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620938:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620943:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620948:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620953:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620959:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620964:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620969:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620974:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620980:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620986:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620991:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.620996:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621001:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621006:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621011:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621017:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621023:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621028:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621033:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621038:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621042:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621048:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621052:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621057:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.621470:0:17131:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93d26c759a00:17131] 0 exiting: rc = 1 00000100:00100000:0.0:1790773396.621929:0:17132:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93d26c758e00:17132] 1 exiting: rc = 0 00000100:00100000:2.0:1790773396.622088:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622095:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622102:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622107:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622113:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622118:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622123:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622128:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622133:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622137:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622143:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622148:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622154:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622159:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622165:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622170:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622176:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.622181:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623023:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623037:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623043:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623048:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623054:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623060:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623065:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623071:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623075:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623081:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623087:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623092:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623097:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623102:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623107:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623112:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623133:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623139:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623144:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623149:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623154:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623159:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623164:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623170:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623175:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623180:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623391:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623401:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623406:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623411:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623417:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623422:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623427:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623433:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623438:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623443:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623615:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623625:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623630:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623635:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623640:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623645:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623650:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623655:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623660:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.623665:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.625683:0:17133:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff93d26c758a00:17133] 0 exiting: rc = 1 00000100:00100000:1.0:1790773396.625851:0:17134:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff93d26c758600:17134] 1 exiting: rc = 0 00000100:00100000:0.0:1790773396.625903:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625911:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625916:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625921:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625926:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625930:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625935:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625941:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625947:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625966:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625971:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625976:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625981:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625986:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625991:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.625996:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626002:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626006:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626011:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626017:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626022:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626027:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626032:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626037:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626043:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626048:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626054:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626059:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626065:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626070:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626075:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626081:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626085:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626090:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626096:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626101:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626106:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626112:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626117:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626122:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626127:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626135:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626142:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626147:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626160:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626165:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626170:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626175:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626180:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626185:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626189:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626195:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626200:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626227:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626233:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626240:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626246:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626251:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626256:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626260:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626265:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626270:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626275:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.626280:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773396.626923:0:17135:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff93d26c759200:17135] 0 exiting: rc = 1 00000100:00100000:1.0:1790773396.626935:0:17136:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff93d26c759800:17136] 1 exiting: rc = 0 00000100:00100000:2.0:1790773396.627095:0:17137:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff93d26c758000:17137] 2 exiting: rc = 0 00000100:00100000:0.0:1790773396.627512:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627521:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627527:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627533:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627556:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627563:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627569:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627575:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627581:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627586:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627592:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627599:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627604:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627610:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627615:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627633:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627638:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627644:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627649:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627655:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627661:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627667:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627673:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627678:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627688:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627694:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627700:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627706:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627727:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627735:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627740:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627746:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627753:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627769:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627776:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.627785:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628120:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628130:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628135:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628140:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628146:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628151:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628157:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628163:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628169:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628175:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628180:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628186:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628192:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628197:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628415:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628421:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628440:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628446:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628519:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628527:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628533:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628540:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628546:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628552:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628559:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628566:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628571:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790773396.628576:0:20894:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1790773396.644979:0:20894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773396.645010:0:20894:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1790773396.645017:0:20894:0:(genops.c:885:class_export_put()) final put ffff93d251154800/MDS_uuid 00000020:00000080:2.0:1790773396.645023:0:20894:0:(genops.c:844:class_export_destroy()) destroying export ffff93d251154800/MDS_uuid for MDS 00000020:01000000:2.0:1790773396.645029:0:20894:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1790773396.645173:0:20894:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790773396.693350:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773397.709554:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773397.837309:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773397.837321:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773397.837324:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773397.837328:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790773397.837332:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773397.837340:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1790773397.837345:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790773397.837357:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d143389000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773397.837398:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d280f6f100 x1877761496141568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773397.837510:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773397.837514:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790773397.837516:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773397.837520:0:15123:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1790773397.837524:0:15123:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790773397.837531:0:15123:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d280f72800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773397.837608:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d280f6d180 x1877761496141824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773397.837705:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496141568:0@lo:38:kworker.0 00000400:00000100:1.0:1790773397.837772:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496141568 offset 0 length 520: 4 00000100:00100000:1.0:1790773397.838614:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496141824:0@lo:38:kworker.0 00000400:00000100:1.0:1790773397.838655:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496141824 offset 0 length 520: 4 00000100:00100000:1.0:1790773397.838707:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773397.838717:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496141696:0@lo:400:kworker.0 00000400:00000100:1.0:1790773397.838743:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496141696 offset 0 length 224: 4 00000100:00100000:1.0:1790773397.838854:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496141952:0@lo:400:kworker.0 00000400:00000100:1.0:1790773397.838948:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496141952 offset 0 length 224: 4 00010000:00010000:1.0:1790773398.738593:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773399.759439:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773400.781395:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790773401.110507:0:21095:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790773401.125846:0:21095:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790773401.125944:0:21095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773401.125968:0:21095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773401.125978:0:21095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773401.125988:0:21095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773401.126026:0:21095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790773401.126057:0:21095:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790773401.126097:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773401.126116:0:21095:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d280f6f100 x1877761496141568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773412 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773401.126144:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790773401.126197:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773401.126229:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1790773401.126235:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496141568:0@lo:38:kworker.0 00000100:00080000:1.0:1790773401.126276:0:21095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790773401.126284:0:21095:0:(import.c:65:import_set_state_nolock()) ffff93d143389000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1790773401.126291:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790773401.126293:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790773401.126297:0:21095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790773401.127371:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773401.127387:0:21095:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d280f6c000 x1877761496141696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773401.127406:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790773401.127411:0:21095:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1790773401.127444:0:21095:0:(import.c:65:import_set_state_nolock()) ffff93d1431fa800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1790773401.127489:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496142080:0@lo:39:umount.0 00000400:00000100:1.0:1790773401.127564:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142080 offset 0 length 224: 4 00010000:00010000:2.0:1790773401.127861:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773401.127876:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773401.127889:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ac800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773401.127895:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773401.127909:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773401.127920:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773401.127927:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773401.127931:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790773401.127935:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790773401.127963:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773401.127968:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773401.127977:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ac800/0xabf1cc0bc7842cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842cbb expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773401.128018:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773401.128021:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773401.128023:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773401.128457:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496141696:0@lo:400:kworker.0 00010000:00010000:1.0:1790773401.805782:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790773401.871341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773401.871362:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773401.871366:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773401.871370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773401.871508:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773401.873564:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142208:0@lo:400:kworker.0 00000400:00000100:1.0:1790773401.873660:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142208 offset 0 length 224: 4 00010000:00010000:2.0:1790773402.829493:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773402.893794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773402.893813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773402.893817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790773402.893821:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773402.893949:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773402.899498:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496142336:0@lo:400:kworker.0 00000400:00000100:3.0:1790773402.899596:0:3607:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142336 offset 0 length 224: 4 00010000:00010000:2.0:1790773403.856740:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773404.877605:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773405.901511:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773406.285436:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773396/real 1790773396] req@ffff93d1444c4e00 x1877761496141440/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790773406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773406.285485:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d1444c4e00 x1877761496141440/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790773406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773406.285515:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773406.285551:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1790773406.285556:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496141440:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1790773406.286007:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773406.286014:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1790773406.286020:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773406.286029:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1790773406.286039:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.119@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790773406.286063:0:38:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d26ec39000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773406.286120:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c5c00 x1877761496142464/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773406.286151:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790773406.286156:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790773406.286261:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773406.286283:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496142592:0@lo:400:kworker.0 00000400:00000100:0.0:1790773406.286360:0:3606:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142592 offset 0 length 224: 4 00000100:00100000:1.0:1790773406.286366:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496142464:0@lo:250:kworker.0 00000400:00000100:1.0:1790773406.287340:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877761496142464 offset 0 length 520: 4 00010000:00010000:2.0:1790773406.926279:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773407.950444:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773408.973456:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773409.998491:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773411.022787:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773411.405520:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773401/real 1790773401] req@ffff93d280f6f100 x1877761496142080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773411.405572:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d280f6f100 x1877761496142080/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773411 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773411.405607:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1431fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1790773411.405670:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496142080:0@lo:39:umount.0 00000100:00080000:0.0:1790773411.405908:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773411.405917:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790773411.405924:0:21095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790773411.409412:0:21095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409438:0:21095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409465:0:21095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409474:0:21095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409505:0:21095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773411.409515:0:21095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409523:0:21095:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409530:0:21095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409537:0:21095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773411.409561:0:21095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790773411.409567:0:21095:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1790773411.409769:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773411.409780:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409788:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434ad600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773411.409792:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409816:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773411.409825:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773411.409831:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773411.409834:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1790773411.409836:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1790773411.409853:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773411.409858:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409865:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ad600/0xabf1cc0bc7842c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842c91 expref: -99 pid: 18623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409883:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773411.409886:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409893:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2600 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773411.409897:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409904:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773411.409911:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773411.409928:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790773411.409930:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790773411.409932:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790773411.409939:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773411.409942:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409949:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2600/0xabf1cc0bc7842fee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842ff5 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773411.409960:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773411.409962:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773411.409965:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790773411.410010:0:21095:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1790773411.410016:0:21095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1790773411.410022:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773411.410029:0:21095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790773411.410035:0:21095:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff93d27b2c4d40) has no exports 00000020:00080000:0.0:1790773411.410067:0:21095:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff93d27b2c4d40) has no exports 00010000:00010000:3.0:1790773411.410723:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790773411.416170:0:21095:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d26ee74ba0 - data ffff93d2739a1288/ffff93d244017c00 00000020:01000000:1.0:1790773411.418389:0:21095:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d248dcc1e0 - data ffff93d2738ad798/ffff93d25ebabc00 00100000:10000000:1.0:1790773411.439768:0:21095:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1790773411.461147:0:21095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842c9f 00000020:00000080:3.0:1790773411.461175:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d14328f800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1790773411.461308:0:21095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26be90800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1790773411.461320:0:21095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26be90800 2 00000020:01000004:3.0:1790773411.461325:0:21095:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d26be90800 from lustre-OST0000 00000020:00000080:3.0:1790773411.461379:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790773411.461396:0:21095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1790773411.461401:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d143288800/lustre-OST0000_UUID 00000020:00000080:3.0:1790773411.461404:0:21095:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143288800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1790773411.461434:0:21095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1790773411.461546:0:21095:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1790773411.461553:0:21095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790773411.461558:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790773411.461566:0:21095:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790773411.461577:0:21095:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93d143388800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790773411.461584:0:21095:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff93d26bfc3380) has exports, disconnecting them 00000020:00080000:3.0:1790773411.461591:0:21095:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93d143388800), last request at 1790773334 00000020:00000080:3.0:1790773411.461596:0:21095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842cc9 00000020:00080000:3.0:1790773411.461609:0:21095:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d143388800): rc 0 00000020:00000080:3.0:1790773411.461640:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d143388800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790773411.463959:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14328f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:0.0:1790773411.465258:0:21095:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790773411.465294:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773411.465300:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773411.465312:0:21095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773411.465522:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143388800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790773411.465533:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773411.465540:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d143389000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790773411.465550:0:21095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790773411.465560:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d141f9d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790773411.465565:0:21095:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141f9d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790773411.465583:0:21095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1790773411.465859:0:21095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1790773411.465865:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773411.465874:0:21095:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773411.465885:0:21095:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff93d1431f8000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773411.465894:0:21095:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff93d279ea19c0) has exports, disconnecting them 00000020:00080000:0.0:1790773411.465899:0:21095:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff93d1431f8000), last request at 1790773334 00000020:00000080:0.0:1790773411.465906:0:21095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842cde 00000020:00080000:0.0:1790773411.465926:0:21095:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d1431f8000): rc 0 00000020:00000080:0.0:1790773411.465932:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d1431f8000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790773411.466825:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1431f8000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1790773411.466872:0:21095:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790773411.466896:0:21095:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773411.466901:0:21095:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790773411.466909:0:21095:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773411.466935:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d1431fa800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1790773411.467137:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773411.467146:0:21095:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1790773411.467151:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d280f71800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1790773411.467154:0:21095:0:(genops.c:844:class_export_destroy()) destroying export ffff93d280f71800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1790773411.467159:0:21095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1790773411.467254:0:21095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26be90800 1 00000020:00000080:1.0:1790773411.467263:0:21095:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842c7c 00000020:00000080:1.0:1790773411.467270:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d143286800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1790773411.467278:0:21095:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790773411.467286:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143286800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790773411.467295:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773411.467319:0:21095:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773411.467323:0:21095:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff93d262660000) has no exports 00000100:00080000:1.0:1790773411.663878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773411.663895:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773411.663899:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790773411.663903:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773411.664014:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142720:0@lo:400:kworker.0 00000400:00000100:1.0:1790773411.664089:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142720 offset 0 length 224: 4 00000020:00000080:1.0:1790773411.732592:0:21095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773411.732707:0:21095:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790773411.732714:0:21095:0:(genops.c:885:class_export_put()) final put ffff93d26be93800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790773411.732720:0:21095:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26be93800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790773411.732758:0:21095:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790773411.734051:0:21095:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d26be93000 00000020:02000400:1.0:1790773411.734134:0:21095:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1790773412.047092:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773412.431257:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773397/real 1790773397] req@ffff93d280f6d180 x1877761496141824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790773412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773412.431318:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d280f6d180 x1877761496141824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1790773412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773412.431344:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773412.431381:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790773412.431387:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496141824:0@lo:38:kworker.0 00000100:00080000:3.0:1790773412.431776:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773412.431784:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773412.431787:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773412.431790:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790773412.431796:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773412.431804:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1790773412.431811:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790773412.431828:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d280f72800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773412.431893:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dc700 x1877761496142848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790773412.432005:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496142848:0@lo:38:kworker.0 00000400:00000100:1.0:1790773412.432091:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142848 offset 0 length 520: 4 00000100:00100000:0.0:1790773412.432272:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773412.432286:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142976:0@lo:400:kworker.0 00000400:00000100:0.0:1790773412.432318:0:3604:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496142976 offset 0 length 224: 4 00010000:00010000:2.0:1790773413.073316:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1790773413.453742:0:3604:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773397/real 1790773397] req@ffff93d280f6dc00 x1877761496141952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773413.497178:0:3604:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff93d280f6dc00 x1877761496141952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790773413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773413.497243:0:3604:0:(import.c:65:import_set_state_nolock()) ffff93d141c46800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790773413.497249:0:3604:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790773413.520432:0:3604:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1790773413.520818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773413.520828:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773413.520833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773413.520836:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773413.520874:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1790773413.520879:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773413.520887:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d141c46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773413.520901:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1790773413.520928:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d141c46800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773413.521007:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dc380 x1877761496143104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773413.521225:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496143104:0@lo:38:kworker.0 00000400:00000100:2.0:1790773413.521308:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877761496143104 offset 0 length 520: 4 00000100:00100000:1.0:1790773413.524935:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496141952:0@lo:400:kworker.0 00010000:00010000:0.0:1790773414.097459:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773415.117798:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773416.141326:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790773416.170918:0:21298:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790773416.192602:0:21298:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1790773416.192858:0:21298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.192892:0:21298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.192903:0:21298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.192914:0:21298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.193000:0:21298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790773416.193014:0:21298:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790773416.193078:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1790773416.193103:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1790773416.193111:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447dc700 x1877761496142848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773432 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790773416.193123:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773416.193137:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773416.193145:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773416.193155:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1790773416.193161:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790773416.193168:0:21298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1790773416.193175:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790773416.193185:0:21298:0:(import.c:65:import_set_state_nolock()) ffff93d280f72800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1790773416.193186:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790773416.193193:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790773416.193198:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1790773416.193199:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790773416.193262:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447dc700 x1877761496142848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773432 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773416.193272:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:0.0:1790773416.193274:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00000100:00100000:2.0:1790773416.193277:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:0.0:1790773416.193282:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773416.193292:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12a000/0xabf1cc0bc7842d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842d55 expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773416.193342:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496142848:0@lo:38:kworker.0 00010000:00010000:0.0:1790773416.193395:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773416.193398:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773416.193399:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773416.195676:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773416.195745:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447de300 x1877761496142208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195796:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143e01880 x1877761496142336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195822:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1444c4a80 x1877761496142592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195858:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d280f6f100 x1877761496142720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773427 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195870:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447df100 x1877761496142976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773428 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195883:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447dc380 x1877761496143104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195901:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790773416.195912:0:21298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790773416.195923:0:21298:0:(import.c:65:import_set_state_nolock()) ffff93d141c46800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790773416.195936:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790773416.195940:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447de300 x1877761496142208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773417 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195951:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d143e01880 x1877761496142336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773418 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195960:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1444c4a80 x1877761496142592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773422 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.195969:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d280f6f100 x1877761496142720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773427 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773416.196389:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142976:0@lo:400:kworker.0 00000100:00100000:2.0:1790773416.196476:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496142336:0@lo:400:kworker.0 00000100:00100000:3.0:1790773416.196630:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3606:1877761496142592:0@lo:400:kworker.0 00000100:00100000:0.0:1790773416.197852:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447df100 x1877761496142976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773428 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.197863:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d2447dc380 x1877761496143104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790773423 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773416.197900:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790773416.198689:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142720:0@lo:400:kworker.0 00000100:00100000:1.0:1790773416.198705:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496142208:0@lo:400:kworker.0 00000100:00100000:1.0:1790773416.198801:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496143104:0@lo:38:kworker.0 00000100:00100000:0.0:1790773416.202111:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790773416.205880:0:21298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206150:0:21298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206159:0:21298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206167:0:21298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206601:0:21298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773416.206618:0:21298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206627:0:21298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206635:0:21298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773416.206644:0:21298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207155:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773416.207169:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207181:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d1434acc00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773416.207188:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207201:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773416.207316:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773416.207340:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773416.207344:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790773416.207366:0:20149:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773416.207372:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207381:0:20149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434acc00/0xabf1cc0bc7842d24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842d2b expref: -99 pid: 19440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207402:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773416.207405:0:20149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207411:0:20149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773416.207414:0:20149:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207421:0:20149:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773416.207429:0:20149:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773416.207435:0:20149:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790773416.207437:0:20149:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790773416.207441:0:20149:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773416.207444:0:20149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.207461:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773416.207463:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773416.207465:0:20149:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773416.207737:0:21298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790773416.207745:0:21298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc7842fe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842fe7 expref: -99 pid: 17120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773416.207770:0:21298:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790773416.207778:0:21298:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1790773416.207782:0:21298:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1790773416.207875:0:21298:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1790773416.207883:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1790773416.207896:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773416.207922:0:21298:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773416.207931:0:21298:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff93d262663380) has no exports 00000020:00080000:1.0:1790773416.208010:0:21298:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff93d262663380) has no exports 00010000:00010000:2.0:1790773416.215623:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790773416.216487:0:21298:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d26ee74ae0 - data ffff93d27383b438/ffff93d244016000 00000020:01000000:1.0:1790773416.216749:0:21298:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff93d248dcc360 - data ffff93d251ad00d8/ffff93d244048400 00100000:10000000:0.0:1790773416.236115:0:21298:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790773416.259911:0:21298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d39 00000020:00000080:2.0:1790773416.259980:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d143294800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790773416.260048:0:21298:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14316e800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790773416.260052:0:21298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14316e800 2 00000020:01000004:2.0:1790773416.260056:0:21298:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d14316e800 from lustre-OST0001 00000020:00000080:2.0:1790773416.260087:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773416.260100:0:21298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790773416.260103:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d143293800/lustre-OST0001_UUID 00000020:00000080:2.0:1790773416.260107:0:21298:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143293800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790773416.260117:0:21298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790773416.260626:0:21298:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import cdd0c180-4c21-4c72-90c1-0147a5902c2f->MGS 00010000:00010000:2.0:1790773416.260648:0:21298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773416.260661:0:21298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773416.260667:0:21298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790773416.260670:0:21298:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790773416.260675:0:21298:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790773416.260693:0:21298:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773416.260697:0:21298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d1434ada00/0xabf1cc0bc7842b48 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842b4f expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773416.260721:0:21298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773416.260742:0:21298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773416.260754:0:21298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790773416.260815:0:21298:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790773416.260817:0:21298:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790773416.260832:0:21298:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d26ec39000 00010000:00010000:2.0:1790773416.260835:0:21298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12bc00/0xabf1cc0bc7842a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xabf1cc0bc7842a3e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790773416.260857:0:21298:0:(import.c:65:import_set_state_nolock()) ffff93d26ec39000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790773416.260862:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790773416.260865:0:21298:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790773416.260867:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790773416.260873:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790773416.260886:0:21298:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d1444c5c00 x1877761496142464/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790773421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790773416.260959:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790773416.260962:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:1.0:1790773416.261111:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143294800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1790773416.261441:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cdd0c180-4c21-4c72-90c1-0147a5902c2f:3603:1877761496142464:0@lo:250:kworker.0 10000000:01000000:2.0:1790773416.261644:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790773416.261662:0:21298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842a22 00000020:00000080:2.0:1790773416.261670:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d25268e000/cdd0c180-4c21-4c72-90c1-0147a5902c2f 00000020:01000000:2.0:1790773416.261697:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.119@tcp (flags='') 00000020:00000080:2.0:1790773416.261705:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773416.261712:0:21298:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790773416.261718:0:21298:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93d281ba99c0) has no exports 00000020:00000080:1.0:1790773416.261754:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d25268e000/cdd0c180-4c21-4c72-90c1-0147a5902c2f for MGC192.168.202.119@tcp 10000000:01000000:1.0:1790773416.262098:0:17120:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790773416.262621:0:21298:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.119@tcp: client import never connected 00000100:00080000:2.0:1790773416.262627:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790773416.262631:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790773416.262635:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790773416.262656:0:21298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790773416.262912:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790773416.262920:0:21298:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.119@tcp (uuid cdd0c180-4c21-4c72-90c1-0147a5902c2f) 00000020:01000000:2.0:1790773416.262928:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790773416.262932:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790773416.262938:0:21298:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790773416.262945:0:21298:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93d141c40000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790773416.262953:0:21298:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff93d26ec20000) has exports, disconnecting them 00000020:00080000:2.0:1790773416.262958:0:21298:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93d141c40000), last request at 1790773350 00000020:00000080:2.0:1790773416.262963:0:21298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d63 00000020:00080000:2.0:1790773416.262979:0:21298:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d141c40000): rc 0 00000020:00000080:2.0:1790773416.262983:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d141c40000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790773416.263010:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d26ec39000 for MGC192.168.202.119@tcp 00000020:00000080:1.0:1790773416.263021:0:8:0:(genops.c:885:class_export_put()) final put ffff93d26ec3b800/cdd0c180-4c21-4c72-90c1-0147a5902c2f 00000020:00000080:1.0:1790773416.263024:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ec3b800/cdd0c180-4c21-4c72-90c1-0147a5902c2f for MGC192.168.202.119@tcp 00000020:01000000:1.0:1790773416.263031:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.119@tcp (cdd0c180-4c21-4c72-90c1-0147a5902c2f) 00000020:00000080:1.0:1790773416.263974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c40000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790773416.275646:0:21298:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790773416.275656:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790773416.275661:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790773416.275670:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790773416.275924:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790773416.275937:0:21298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790773416.275946:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790773416.275955:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790773416.275961:0:21298:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790773416.275971:0:21298:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff93d141c42800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790773416.275980:0:21298:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff93d26ec219c0) has exports, disconnecting them 00000020:00080000:0.0:1790773416.275985:0:21298:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff93d141c42800), last request at 1790773350 00000020:00000080:0.0:1790773416.275991:0:21298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d78 00000020:00080000:0.0:1790773416.276011:0:21298:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d141c42800): rc 0 00000020:00000080:0.0:1790773416.276019:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d141c42800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1790773416.276160:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d280f72800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1790773416.276174:0:8:0:(genops.c:885:class_export_put()) final put ffff93d1431ff800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1790773416.276178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d1431ff800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1790773416.276185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1790773416.276300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c42800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1790773416.280415:0:21298:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1790773416.280427:0:21298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1790773416.280433:0:21298:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790773416.280444:0:21298:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790773416.280486:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93d141c46800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1790773416.339312:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790773416.340840:0:20149:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1790773416.341182:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1790773416.341454:0:20147:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93d27dfc4000:20147] 2 exiting: rc = 0 00000100:00100000:1.0:1790773416.341533:0:17106:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93d252380c00:17106] 1 exiting: rc = 0 00000100:00100000:3.0:1790773416.352374:0:17105:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93d142720600:17105] 0 exiting: rc = 1 00000100:00100000:1.0:1790773416.352752:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.358151:0:17109:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93d26efce200:17109] 2 exiting: rc = 0 00000100:00100000:3.0:1790773416.359683:0:17108:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93d26efcf600:17108] 1 exiting: rc = 0 00000100:00100000:2.0:1790773416.360968:0:17107:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93d26efce800:17107] 0 exiting: rc = 1 00000100:00100000:2.0:1790773416.361070:0:20148:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93d27dfc5c00:20148] 3 exiting: rc = 0 00000100:00100000:1.0:1790773416.361242:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361253:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361259:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361265:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361274:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361281:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361294:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361300:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361306:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361311:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361316:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361322:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361327:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361332:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361338:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361343:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361348:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361353:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361358:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361363:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361368:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361372:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361378:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361383:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361388:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361393:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361397:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361402:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361406:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361411:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361415:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361419:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361437:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361443:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361449:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361454:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361467:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361472:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361477:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361482:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361487:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361492:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361497:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361504:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361509:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361513:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361518:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361522:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361526:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361531:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361535:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361540:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361544:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361548:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361553:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361557:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361561:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361566:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361579:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361585:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361590:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361595:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361600:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.361606:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790773416.362384:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773416.362395:0:21298:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1790773416.362402:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d141c45000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1790773416.362413:0:21298:0:(genops.c:844:class_export_destroy()) destroying export ffff93d141c45000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1790773416.362417:0:21298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1790773416.362465:0:21298:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14316e800 1 00000020:00000080:1.0:1790773416.362470:0:21298:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xabf1cc0bc7842d1d 00000020:00000080:1.0:1790773416.362476:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d26ef96800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1790773416.362486:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1790773416.362495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d26ef96800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1790773416.362504:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773416.362508:0:21298:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773416.362511:0:21298:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff93d2626619c0) has no exports 00000020:00000080:1.0:1790773416.482185:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773416.482229:0:21298:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1790773416.482241:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d14316d000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1790773416.482250:0:21298:0:(genops.c:844:class_export_destroy()) destroying export ffff93d14316d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790773416.482278:0:21298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1790773416.487093:0:21298:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d14316b000 00000020:01000000:1.0:1790773416.487162:0:21298:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1790773416.487186:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790773416.487195:0:21298:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790773416.487202:0:21298:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff93d26bfc4d40) has no exports 00000020:00000080:1.0:1790773416.488549:0:21298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790773416.488594:0:21298:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1790773416.488603:0:21298:0:(genops.c:885:class_export_put()) final put ffff93d143285000/OSS_uuid 00000020:00000080:1.0:1790773416.488610:0:21298:0:(genops.c:844:class_export_destroy()) destroying export ffff93d143285000/OSS_uuid for OSS 00000020:01000000:1.0:1790773416.488623:0:21298:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790773416.490781:0:18628:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff93d244124200:18628] 0 exiting: rc = 1 00000100:00100000:2.0:1790773416.490971:0:18630:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff93d280f5a200:18630] 2 exiting: rc = 0 00000100:00100000:3.0:1790773416.491975:0:19515:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff93d144709000:19515] 4 exiting: rc = 0 00000100:00100000:3.0:1790773416.492162:0:18629:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff93d280f5a400:18629] 1 exiting: rc = 0 00000100:00080000:0.0:1790773416.492652:0:17118:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1790773416.492943:0:19203:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff93d1434c7a00:19203] 3 exiting: rc = 0 00000100:00100000:1.0:1790773416.493093:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493105:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493111:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493119:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493126:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493135:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493154:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493917:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493924:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493930:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493935:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493942:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493948:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493955:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493961:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493966:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493971:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493978:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493984:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493990:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.493998:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494004:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494011:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494019:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494024:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494029:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494035:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494043:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494049:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494055:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494062:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494069:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494074:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494080:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494090:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494098:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494104:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494114:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494123:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494131:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494136:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.494152:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496018:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496042:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496050:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496057:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496067:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496074:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496080:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496088:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496094:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496103:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496111:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496117:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496124:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496131:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496136:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496142:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496148:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496153:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.496159:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.497607:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.497642:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.497649:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.502679:0:18632:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93d143014200:18632] 1 exiting: rc = 0 00000100:00100000:1.0:1790773416.504939:0:18631:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93d26c483a00:18631] 0 exiting: rc = 1 00000100:00100000:2.0:1790773416.505094:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505104:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505110:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505117:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505123:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505130:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505137:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505158:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505170:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505181:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505564:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505584:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505616:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505626:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505635:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505641:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505647:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505653:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505659:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505666:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505672:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505679:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.505686:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507736:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507767:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507776:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507782:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507798:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507808:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507815:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507821:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507827:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507834:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507841:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507848:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507854:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507860:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507866:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507872:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507878:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507883:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507891:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507897:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507903:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507909:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507915:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507922:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507953:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507959:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507966:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507973:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507978:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507986:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507991:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.507998:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508003:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508009:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508015:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508020:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508026:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508032:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508037:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508044:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.508052:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.509642:0:18633:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93d280f5ac00:18633] 0 exiting: rc = 1 00000100:00100000:1.0:1790773416.510000:0:18634:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93d280d06800:18634] 1 exiting: rc = 0 00000100:00100000:0.0:1790773416.510200:0:20263:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff93d27dfc4800:20263] 3 exiting: rc = 0 00000100:00100000:3.0:1790773416.510661:0:18635:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93d25175e000:18635] 2 exiting: rc = 0 00000100:00100000:3.0:1790773416.511159:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511170:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511177:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511184:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511191:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511198:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511239:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511253:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511276:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511285:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511292:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511300:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511308:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511316:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511324:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511357:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511365:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511373:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511381:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511390:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511398:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511407:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511415:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511424:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511436:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511447:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511456:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511465:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511473:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511483:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511491:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511502:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511525:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511534:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511541:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511549:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511557:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511565:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511583:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511592:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511600:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511610:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511618:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511627:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511634:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511643:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511651:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511658:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511665:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511672:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511688:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511694:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511711:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511858:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511869:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511879:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511889:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511907:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511917:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511927:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511936:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.511944:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.512096:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.512107:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790773416.531960:0:18637:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93d143788200:18637] 1 exiting: rc = 0 00000100:00100000:1.0:1790773416.532082:0:18636:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93d143788800:18636] 0 exiting: rc = 1 00000100:00100000:2.0:1790773416.532606:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532616:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532624:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532629:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532635:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532641:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532646:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532652:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532658:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532666:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532673:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532678:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532684:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532690:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532705:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532711:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532717:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532748:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532755:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532760:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532766:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532771:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532777:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532783:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532789:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532794:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532801:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532807:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532812:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532818:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532825:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532831:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532837:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532843:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532850:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532855:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532861:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532868:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532873:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532880:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532887:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532892:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532898:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532904:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532910:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532915:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532920:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532926:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532932:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532938:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532944:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532950:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532966:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532972:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532979:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532985:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532991:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.532995:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533001:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533006:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533011:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533018:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533024:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.533030:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790773416.535584:0:18638:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93d2442ad600:18638] 0 exiting: rc = 1 00000100:00100000:3.0:1790773416.538001:0:18639:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93d2442ac000:18639] 1 exiting: rc = 0 00000100:00100000:2.0:1790773416.538180:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538241:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538248:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538255:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538598:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538607:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538614:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538622:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538629:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538636:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538643:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538649:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538656:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538662:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538669:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538677:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538711:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538720:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538727:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538734:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538742:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538750:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538757:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538789:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538797:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538805:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538813:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538821:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538843:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538851:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538858:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538866:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538875:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538882:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538890:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538898:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538906:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538914:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538921:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538930:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538951:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538960:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538967:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538975:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538982:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538990:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.538997:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539004:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539011:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539020:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539027:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539034:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539053:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539062:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539070:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539078:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539086:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539093:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539105:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539113:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539121:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539128:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539134:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790773416.539143:0:21298:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1790773416.574152:0:21298:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790773441.591084:0:22063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790773451.273694:0:22662:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790773451.273705:0:22662:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1790773451.273708:0:22662:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1790773451.273851:0:22662:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d24f7ba800 00000020:01000004:2.0:1790773451.273868:0:22662:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790773451.273876:0:22662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790773451.273892:0:22662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93d262663380) 00000020:00000080:2.0:1790773451.273907:0:22662:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790773451.434457:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.442768:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790773451.460050:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1790773451.462600:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.470156:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.470789:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.471472:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.471714:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790773451.471987:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.473054:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790773451.474497:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1790773451.483866:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.484302:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.484572:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790773451.484768:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1790773451.485001:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.489556:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.490023:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.490431:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.490655:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.491444:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.492496:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.494089:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.495433:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.495809:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.498504:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.500155:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.500846:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.501133:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.501526:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.502009:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1790773451.502413:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1790773451.502637:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790773451.512534:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1790773451.515745:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790773451.517397:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.518045:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.519733:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.520361:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.525409:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.526431:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.526905:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.527233:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.534168:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.535023:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790773451.535320:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.535590:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.541141:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.542027:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.546405:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.551378:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.553622:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790773451.556433:0:22662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1790773451.556994:0:22662:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773451.557348:0:22662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790773451.557358:0:22662:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773451.557372:0:22662:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc784328e 00000020:01000004:1.0:1790773451.557379:0:22662:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790773451.557385:0:22662:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790773451.557390:0:22662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d24f7ba800 from MGS 00000020:01000004:1.0:1790773451.557394:0:22662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790773451.557402:0:22662:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93d26bfc0000) 00000020:00000080:1.0:1790773451.557412:0:22662:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790773451.557478:0:22662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d24f7ba800 from MGS, refs=2 00080000:01000000:1.0:1790773451.557484:0:22662:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790773451.557489:0:22662:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc784329c 00000100:00100000:1.0:1790773451.557588:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790773451.557723:0:22662:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790773451.557729:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790773451.562483:0:22662:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790773451.563021:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790773451.564025:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773451.564696:0:22662:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790773451.564706:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790773451.566172:0:22662:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790773451.566183:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790773451.568136:0:22662:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790773451.568150:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790773451.569090:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773451.569094:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773451.569096:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773451.569439:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773451.569442:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773451.569444:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773451.569901:0:22662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790773451.573265:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790773451.588860:0:22662:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1790773451.602394:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790773451.602480:0:22662:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790773451.602552:0:22662:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790773451.603377:0:22662:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790773451.603729:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773451.603904:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790773451.603910:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790773451.610045:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790773451.610059:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790773451.610598:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790773451.610605:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790773451.618030:0:22662:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790773451.618056:0:22662:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:1.0:1790773451.618058:0:22662:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790773451.618086:0:22662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:1.0:1790773451.618101:0:22662:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (ffff93d26bfc19c0) 00000020:00000080:1.0:1790773451.618116:0:22662:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790773451.618201:0:22662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d252689000@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773451.618441:0:22662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:1.0:1790773451.618449:0:22662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790773451.623959:0:22679:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1790773451.624005:0:22680:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790773451.624048:0:22662:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid a65cda49-ef94-4b32-a3e4-9e24580a945a) 00000020:00000080:3.0:1790773451.624070:0:22662:0:(genops.c:1384:class_connect()) connect: client a65cda49-ef94-4b32-a3e4-9e24580a945a, cookie 0xabf1cc0bc78432aa 00000100:00080000:3.0:1790773451.624082:0:22662:0:(import.c:545:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773451.624094:0:22662:0:(import.c:666:import_select_connection()) MGC192.168.202.119@tcp: import ffff93d252689000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773451.624127:0:22662:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dfb80 x1877761496143232/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773451.624150:0:22662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a65cda49-ef94-4b32-a3e4-9e24580a945a->MGS 00000020:01000004:3.0:1790773451.624170:0:22662:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790773451.624174:0:22662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790773451.624187:0:22662:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93d27b2c4d40) 00000020:00000080:3.0:1790773451.624199:0:22662:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790773451.630415:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65cda49-ef94-4b32-a3e4-9e24580a945a:3603:1877761496143232:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790773451.630507:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773451.630708:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143232 00000100:00100000:1.0:1790773451.630718:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143232 00000100:00100000:1.0:1790773451.630796:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773451.630804:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3603:x1877761496143232:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1790773451.630832:0:22676:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a65cda49-ef94-4b32-a3e4-9e24580a945a@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:1.0:1790773451.630860:0:22676:0:(genops.c:1384:class_connect()) connect: client a65cda49-ef94-4b32-a3e4-9e24580a945a, cookie 0xabf1cc0bc78432b8 00000100:00080000:1.0:1790773451.631081:0:22676:0:(import.c:65:import_set_state_nolock()) ffff93d25268e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773451.631150:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:3603:x1877761496143232:12345-0@lo:250:mount.lustre.0 Request processed in 345us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773451.631157:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773451.631252:0:3603:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790773451.631263:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:1.0:1790773451.631271:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790773451.631275:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790773451.631279:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d252689000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790773451.631282:0:3603:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790773451.631290:0:3603:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790773451.631296:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a65cda49-ef94-4b32-a3e4-9e24580a945a:3603:1877761496143232:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790773451.643556:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790773451.643788:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790773451.643794:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790773451.646742:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790773451.646755:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790773451.650270:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790773451.650286:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790773451.652498:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773451.652701:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790773451.652707:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790773451.670773:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1790773451.670796:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790773451.751094:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773451.752869:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790773451.752877:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790773451.755400:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790773451.755418:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1790773451.761181:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773451.761496:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790773451.761504:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790773451.762113:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790773451.762123:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1790773451.762695:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773451.762855:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790773451.762859:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790773451.763353:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790773451.763361:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790773451.763927:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773451.764118:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790773451.764123:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790773451.769105:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790773451.769123:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790773451.793142:0:22662:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773451.794046:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790773451.794053:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790773451.795860:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790773451.795872:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790773451.796858:0:22662:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790773451.796867:0:22662:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790773451.798943:0:22662:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790773451.798975:0:22662:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790773451.798981:0:22662:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790773451.799094:0:22662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790773451.799135:0:22662:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790773451.799139:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790773451.799141:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773451.799147:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773451.799148:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773451.799149:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773451.799150:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773451.799152:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773451.799153:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773451.799155:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773451.799156:0:22662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773451.799159:0:22662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790773451.799161:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773451.799162:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773451.799163:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773451.799164:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773451.799165:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773451.799166:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773451.799167:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773451.799168:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773451.799169:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773451.799170:0:22662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773451.799199:0:22662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790773451.799616:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790773451.799697:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.799782:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773451.799846:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143360 00000100:00100000:0.0:1790773451.799853:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143360 00000100:00100000:0.0:1790773451.799931:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773451.799942:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:22662:x1877761496143360:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773451.799988:0:22678:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790773451.799991:0:22678:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790773451.799994:0:22678:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790773451.800433:0:22699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790773451.805293:0:22678:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1790773451.807184:0:22700:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790773451.807192:0:22700:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1790773451.807195:0:22700:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790773451.807198:0:22700:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790773451.807524:0:22700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1790773451.807734:0:22678:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790773451.807748:0:22678:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790773451.809875:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:22662:x1877761496143360:12345-0@lo:253:mount.lustre.0 Request processed in 9927us (10169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773451.809890:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773451.810020:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790773451.810038:0:22662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790773451.810042:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773451.810044:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773451.810045:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773451.810047:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773451.810048:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773451.810049:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773451.810051:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773451.810053:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773451.810054:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773451.810055:0:22662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790773451.810079:0:22662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d24f7ba800 from lustre-MDT0000 10000000:01000000:2.0:1790773451.810114:0:22662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790773451.810129:0:22662:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790773451.810134:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d26bfc19c0 10000000:01000000:2.0:1790773451.810139:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790773451.810148:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d26bfc19c0 from 1 10000000:01000000:2.0:1790773451.810151:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790773451.810189:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.810200:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.810263:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773451.810283:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773451.810324:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.810353:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773451.810478:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143488 00000100:00100000:0.0:1790773451.810485:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143488 00000100:00100000:0.0:1790773451.810529:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773451.810539:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:22662:x1877761496143488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773451.810553:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773451.810568:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d240030c00/0xabf1cc0bc78432c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78432bf expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.810593:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d240030c00/0xabf1cc0bc78432c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78432bf expref: 6 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.810604:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d240030c00/0xabf1cc0bc78432c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78432bf expref: 6 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.810613:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030c00, rc 0) 00000100:00100000:0.0:1790773451.810655:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:22662:x1877761496143488:12345-0@lo:101:mount.lustre.0 Request processed in 117us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773451.810662:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773451.810795:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773451.810809:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.810818:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773451.810868:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773451.810892:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.810915:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773451.811020:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143616 00000100:00100000:0.0:1790773451.811025:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143616 00000100:00100000:0.0:1790773451.811050:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790773451.811056:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:22662:x1877761496143616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773451.811142:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:22662:x1877761496143616:12345-0@lo:501:mount.lustre.0 Request processed in 86us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773451.811149:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773451.811316:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143616:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790773451.811344:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790773451.811371:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811380:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773451.811388:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d24f7ba800 10000000:01000000:2.0:1790773451.811392:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790773451.811396:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d24f7ba800 10000000:01000000:2.0:1790773451.811399:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790773451.811402:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d24f7ba800 from 1 10000000:01000000:2.0:1790773451.811404:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790773451.811421:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811428:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811435:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773451.811445:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773451.811469:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.811497:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773451.811544:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143744 00000100:00100000:0.0:1790773451.811549:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143744 00000100:00100000:0.0:1790773451.811569:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773451.811575:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:22662:x1877761496143744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773451.811582:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773451.811591:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d240030800/0xabf1cc0bc78432d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78432cd expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.811607:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d240030800/0xabf1cc0bc78432d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78432cd expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.811617:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d240030800/0xabf1cc0bc78432d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78432cd expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773451.811624:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030800, rc 0) 00000100:00100000:0.0:1790773451.811657:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+7:22662:x1877761496143744:12345-0@lo:101:mount.lustre.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773451.811663:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773451.811724:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773451.811734:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432d4 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811741:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78432d4 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773451.811757:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790773451.811761:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432d4 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811767:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241526e00/0xabf1cc0bc78432cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432d4 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773451.811772:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790773451.811776:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790773451.811780:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d24f7ba800 10000000:01000000:2.0:1790773451.811782:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790773451.811785:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790773451.811787:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790773451.811800:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811807:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.811814:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773451.811823:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773451.811845:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.811866:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773451.811912:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496143872 00000100:00100000:3.0:1790773451.811916:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496143872 00000100:00100000:3.0:1790773451.811953:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773451.811959:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+7:22662:x1877761496143872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773451.811966:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773451.811974:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78432e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78432db expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773451.811995:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78432e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78432db expref: 8 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773451.812003:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2c00/0xabf1cc0bc78432e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78432db expref: 8 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773451.812009:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2c00, rc 0) 00000100:00100000:3.0:1790773451.812046:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+8:22662:x1877761496143872:12345-0@lo:101:mount.lustre.0 Request processed in 87us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773451.812051:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773451.812196:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496143872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773451.812249:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432e2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773451.812263:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78432e2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773451.812308:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773451.812333:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.812343:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773451.812478:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144000 00000100:00100000:0.0:1790773451.812483:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144000 00000100:00100000:0.0:1790773451.812508:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773451.812515:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+8:22662:x1877761496144000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773451.812652:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22662:x1877761496144000:12345-0@lo:501:mount.lustre.0 Request processed in 138us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773451.812658:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773451.817323:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773451.817919:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773451.818403:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773451.818450:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d24401f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773451.818512:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144128 00000100:00100000:1.0:1790773451.818523:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144128 00000100:00100000:1.0:1790773451.818572:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773451.818581:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22662:x1877761496144128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773451.819377:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22662:x1877761496144128:12345-0@lo:503:mount.lustre.0 Request processed in 794us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773451.819387:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790773451.821433:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773451.821974:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22701:1877761496144256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790773451.822053:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773451.822099:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14323a480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773451.822160:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144256 00000100:00100000:3.0:1790773451.822168:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144256 00000100:00100000:3.0:1790773451.822255:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773451.822267:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22701:x1877761496144256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773451.823062:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22701:x1877761496144256:12345-0@lo:502:llog_process_th.0 Request processed in 796us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773451.823071:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773451.823162:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22701:1877761496144256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790773451.823193:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773451.823228:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.823231:0:22701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790773451.823246:0:22701:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790773451.823249:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773451.823271:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93d262664d40) 00000020:00000080:2.0:1790773451.823289:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790773451.823295:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790773451.823405:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790773451.823413:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc78432f0 00000020:00000080:2.0:1790773451.823649:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790773451.823654:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773451.823657:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.823659:0:22701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790773451.823668:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773451.823672:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.823674:0:22701:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790773451.823677:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773451.823686:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93d2626619c0) 00000020:00000080:2.0:1790773451.823697:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790773451.823701:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790773451.823703:0:22701:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790773451.823706:0:22701:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790773451.823713:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790773451.823759:0:22701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d24f7ba800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790773451.823771:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93d262660000) 00000020:00000080:2.0:1790773451.823779:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790773451.823850:0:22701:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790773451.823855:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7843305 00000020:00000080:2.0:1790773451.824106:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790773451.824112:0:22701:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790773451.824117:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xabf1cc0bc784330c 00080000:01000000:2.0:1790773451.824122:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790773451.824125:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7843313 00010000:00010000:1.0:1790773451.910231:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790773451.910805:0:22701:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1790773451.911136:0:22701:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790773451.911867:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93d26bfc4d40) 00000020:00000080:1.0:1790773451.911888:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1790773451.912083:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:1.0:1790773451.912092:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7843321 00000020:00000080:1.0:1790773451.918808:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790773451.922096:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xabf1cc0bc7843328 00000020:00000080:1.0:1790773451.922580:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790773451.922593:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773451.922600:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.922603:0:22701:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790773451.922605:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790773451.922609:0:22701:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1790773451.922610:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773451.922621:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773451.922622:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790773451.922625:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.922626:0:22701:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790773451.922629:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773451.922633:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.922634:0:22701:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790773451.922639:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790773451.922673:0:22701:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790773451.922685:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773451.922688:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.922689:0:22701:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790773451.922692:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773451.922695:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.922696:0:22701:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790773451.922699:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790773451.922704:0:22701:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:1.0:1790773451.922729:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790773451.922744:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff93d26bfc3380) 00000020:00000080:1.0:1790773451.922757:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790773451.922762:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790773451.923123:0:22701:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790773451.923129:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790773451.923141:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7843336 00010000:00080000:1.0:1790773451.923178:0:22701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d25233a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1790773451.932944:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1790773451.936720:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790773451.936738:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790773451.936783:0:22701:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790773451.936806:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc784333d 00000100:00080000:2.0:1790773451.936820:0:22701:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773451.936833:0:22701:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773451.936885:0:22701:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c5880 x1877761496144384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773451.936915:0:22701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1790773451.936957:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144384:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1790773451.936997:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773451.937002:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.937004:0:22701:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790773451.937014:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790773451.937017:0:22701:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1790773451.937019:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773451.937021:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790773451.937023:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790773451.937026:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.937027:0:22701:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790773451.937029:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790773451.937034:0:22701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790773451.937037:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773451.937038:0:22701:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790773451.937041:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790773451.937045:0:22701:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:2.0:1790773451.940026:0:22701:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790773451.940038:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773451.940064:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d141d84d40) 00000020:00000080:2.0:1790773451.940086:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790773451.940092:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790773451.940195:0:22701:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790773451.940218:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790773451.940226:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc784334b 00010000:00080000:2.0:1790773451.940284:0:22701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143271800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773451.940574:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1790773451.940618:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773451.940964:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144384 00000100:00100000:3.0:1790773451.940974:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144384 00000100:00100000:3.0:1790773451.941350:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773451.941360:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496144384:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790773451.941392:0:22688:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1790773451.951286:0:22701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790773451.953593:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1790773451.956882:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3603:x1877761496144384:12345-0@lo:38:llog_process_th.0 Request processed in 15511us (16255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773451.956899:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790773451.957165:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773451.957172:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773451.957177:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144384:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790773451.962253:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773451.962698:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1790773451.970876:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1790773451.972649:0:22707:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790773451.972661:0:22707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790773451.973524:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790773451.973539:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790773451.973588:0:22701:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790773451.973610:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7843352 00000100:00080000:1.0:1790773451.973637:0:22701:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773451.973651:0:22701:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d143271800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773451.973690:0:22701:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d280f6e680 x1877761496144512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773451.973720:0:22701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790773451.973777:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773451.973781:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.973783:0:22701:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790773451.973787:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790773451.973789:0:22701:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1790773451.973791:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773451.973793:0:22701:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790773451.973794:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790773451.973797:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.973799:0:22701:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790773451.973801:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790773451.973806:0:22701:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790773451.973810:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773451.973812:0:22701:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790773451.973816:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790773451.973821:0:22701:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000100:00100000:0.0:1790773451.973830:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144512:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1790773451.973852:0:22701:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790773451.973855:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790773451.973869:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d1435e8000) 00000020:00000080:1.0:1790773451.973881:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1790773451.973885:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790773451.973958:0:22701:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1790773451.973965:0:22701:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:1.0:1790773451.973971:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xabf1cc0bc7843360 00010000:00080000:1.0:1790773451.974001:0:22701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143285000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00000400:00000100:0.0:1790773451.974165:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496144512 offset 0 length 520: 4 00010000:00010000:1.0:1790773451.974274:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1790773451.974345:0:22701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790773451.974361:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790773451.977476:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773451.982417:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1790773451.982690:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1790773451.995468:0:22709:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790773451.995478:0:22709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790773452.000135:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790773452.000158:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790773452.000197:0:22701:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790773452.000610:0:22701:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7843367 00000100:00080000:3.0:1790773452.000621:0:22701:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773452.000630:0:22701:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773452.000661:0:22701:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dca80 x1877761496144640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773452.000686:0:22701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1790773452.001307:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144640:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1790773452.001370:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773452.001377:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000400:00000100:0.0:1790773452.001377:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496144640 offset 0 length 520: 4 00000020:00000080:3.0:1790773452.001381:0:22701:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790773452.001386:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773452.001390:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773452.001392:0:22701:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790773452.001396:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790773452.001399:0:22701:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790773452.001403:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773452.001406:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773452.001407:0:22701:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790773452.001410:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773452.001413:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773452.001415:0:22701:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790773452.001419:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790773452.001457:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22701:1877761496144768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773452.001530:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.001570:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.004368:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144768 00000100:00100000:0.0:1790773452.004394:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144768 00000100:00100000:0.0:1790773452.004491:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790773452.004506:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22701:x1877761496144768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.004784:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22701:x1877761496144768:12345-0@lo:502:llog_process_th.0 Request processed in 282us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.004795:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773452.004824:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22701:1877761496144768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790773452.004892:0:22701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773452.004900:0:22701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773452.004903:0:22701:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790773452.004918:0:22701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1790773452.005730:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1790773452.005759:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790773452.005898:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432e2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773452.005925:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527800/0xabf1cc0bc78432db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432e2 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773452.006140:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d24f7ba800 from 1 10000000:01000000:3.0:1790773452.006145:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790773452.006189:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.006198:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.006348:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773452.006373:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773452.006438:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.006518:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25146b480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773452.006556:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496144896 00000100:00100000:1.0:1790773452.006563:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496144896 00000100:00100000:1.0:1790773452.006629:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773452.006639:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+9:22662:x1877761496144896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773452.006652:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773452.006666:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784336e expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.006688:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 10 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.006699:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 10 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.006708:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773452.006802:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+10:22662:x1877761496144896:12345-0@lo:101:mount.lustre.0 Request processed in 164us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773452.006809:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790773452.007009:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496144896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773452.007024:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.007033:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773452.007944:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145024:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790773452.008021:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.008058:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144000 going to sleep for 11 seconds 00000100:00100000:2.0:1790773452.008622:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145024 00000100:00100000:2.0:1790773452.008631:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145024 00000100:00100000:2.0:1790773452.008681:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773452.008691:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+10:22662:x1877761496145024:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790773452.008711:0:22678:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790773452.008718:0:22678:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790773452.008808:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+10:22662:x1877761496145024:12345-0@lo:256:mount.lustre.0 Request processed in 118us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773452.008817:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773452.009089:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145024:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790773452.009946:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773452.010018:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.010035:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773452.010043:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d24f7ba800 from 1 10000000:01000000:0.0:1790773452.010046:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773452.010082:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.010089:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.010098:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773452.010114:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773452.010158:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.010191:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773452.010322:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145152 00000100:00100000:1.0:1790773452.010330:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145152 00000100:00100000:1.0:1790773452.010367:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773452.010388:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+10:22662:x1877761496145152:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773452.010415:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773452.010429:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784337c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.010449:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 11 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.010459:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 11 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.010468:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12a800, rc 0) 00000100:00100000:1.0:1790773452.010501:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145152:12345-0@lo:101:mount.lustre.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773452.010507:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773452.010634:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773452.010659:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.010668:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773452.010732:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773452.010756:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.010783:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773452.010945:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145280 00000100:00100000:1.0:1790773452.010950:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145280 00000100:00100000:1.0:1790773452.010979:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773452.010994:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773452.011121:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145280:12345-0@lo:501:mount.lustre.0 Request processed in 136us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773452.011128:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773452.011475:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773452.011506:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773452.011544:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.011571:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.011619:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145408 00000100:00100000:3.0:1790773452.011624:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145408 00000100:00100000:3.0:1790773452.011644:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773452.011651:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773452.011733:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145408:12345-0@lo:503:mount.lustre.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.011740:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773452.011869:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773452.012462:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22711:1877761496145536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.012501:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.012529:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6da600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.013921:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145536 00000100:00100000:3.0:1790773452.013932:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145536 00000100:00100000:3.0:1790773452.013976:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773452.014200:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22711:x1877761496145536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773452.015593:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22711:x1877761496145536:12345-0@lo:502:llog_process_th.0 Request processed in 1604us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.015603:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773452.016396:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22711:1877761496145536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790773452.016435:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773452.016446:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016449:0:22711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773452.016457:0:22711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d24f7ba800 00000020:00000080:0.0:1790773452.016459:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773452.016466:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773452.016469:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016470:0:22711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790773452.016479:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773452.016482:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016484:0:22711:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790773452.016487:0:22711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d24f7ba800 00000020:00000080:0.0:1790773452.016489:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773452.016551:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773452.016555:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016556:0:22711:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790773452.016558:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773452.016560:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016561:0:22711:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773452.016564:0:22711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d24f7ba800 00000020:00000080:0.0:1790773452.016566:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773452.016583:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773452.016586:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016588:0:22711:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773452.016590:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773452.016592:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.016594:0:22711:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790773452.016598:0:22711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d24f7ba800 00000020:00000080:0.0:1790773452.016600:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790773452.016643:0:22711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22711:1877761496145664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.016692:0:22711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.016728:0:22711:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6da600 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.017126:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145664 00000100:00100000:3.0:1790773452.017134:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145664 00000100:00100000:3.0:1790773452.017182:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773452.017191:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22711:x1877761496145664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790773452.017331:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22711:x1877761496145664:12345-0@lo:502:llog_process_th.0 Request processed in 140us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.017339:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790773452.018307:0:22711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22711:1877761496145664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790773452.018345:0:22711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773452.018352:0:22711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773452.018354:0:22711:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790773452.018358:0:22711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790773452.020404:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790773452.020475:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773452.020499:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.020512:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773452.020573:0:22662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790773452.020576:0:22662:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d24f7ba800 10000000:01000000:3.0:1790773452.020579:0:22662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d24f7ba800 10000000:01000000:3.0:1790773452.020584:0:22662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773452.020591:0:22662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d24f7ba800 from 1 10000000:01000000:3.0:1790773452.020594:0:22662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790773452.020635:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.020644:0:22662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.020656:0:22662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773452.020694:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773452.020784:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.020830:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.020858:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145792 00000100:00100000:0.0:1790773452.020865:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145792 00000100:00100000:0.0:1790773452.020919:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790773452.020928:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22662:x1877761496145792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773452.020941:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773452.020952:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d240031800/0xabf1cc0bc7843391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784338a expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.020974:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d240031800/0xabf1cc0bc7843391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784338a expref: 12 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.021131:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d240031800/0xabf1cc0bc7843391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784338a expref: 12 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.021139:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240031800, rc 0) 00000100:00100000:0.0:1790773452.021188:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22662:x1877761496145792:12345-0@lo:101:mount.lustre.0 Request processed in 261us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.021194:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773452.021377:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773452.021392:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843391 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.021401:0:22662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843391 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773452.021461:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773452.021486:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.021512:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.021751:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496145920 00000100:00100000:0.0:1790773452.021757:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496145920 00000100:00100000:0.0:1790773452.022936:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790773452.022953:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22662:x1877761496145920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773452.023138:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22662:x1877761496145920:12345-0@lo:501:mount.lustre.0 Request processed in 190us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.025488:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496145920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773452.025555:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496146048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773452.025634:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.025675:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.025696:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146048 00000100:00100000:3.0:1790773452.025704:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146048 00000100:00100000:3.0:1790773452.025750:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773452.025760:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+13:22662:x1877761496146048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773452.025885:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+13:22662:x1877761496146048:12345-0@lo:503:mount.lustre.0 Request processed in 127us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.025893:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773452.025947:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496146048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773452.026430:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790773452.026893:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.034070:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.034132:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773452.034191:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146176 00000100:00100000:2.0:1790773452.034200:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146176 00000100:00100000:2.0:1790773452.034411:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773452.034421:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790773452.034549:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146176:12345-0@lo:502:llog_process_th.0 Request processed in 130us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773452.034557:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790773452.034648:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146176:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790773452.034719:0:22714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790773452.034733:0:22714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93d26ec23380) 00000020:00000080:0.0:1790773452.034754:0:22714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1790773452.034864:0:22714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d24f7ba800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790773452.034869:0:22714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d24f7ba800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790773452.034872:0:22714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d24f7ba800 4 00010000:00080000:0.0:1790773452.034903:0:22714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d141cea000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773452.038474:0:22714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1790773452.040149:0:22714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790773452.040193:0:22714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773452.040228:0:22714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xabf1cc0bc784339f 00000100:00080000:0.0:1790773452.040250:0:22714:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773452.040264:0:22714:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d141cea000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773452.040305:0:22714:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e01f80 x1877761496146304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773452.040348:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496146304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773452.040419:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773452.040479:0:22714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790773452.040810:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146304 00000100:00100000:3.0:1790773452.040819:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146304 00000100:00100000:3.0:1790773452.040860:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773452.040869:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496146304:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773452.040945:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496146304:12345-0@lo:38:llog_process_th.0 Request processed in 75us (523us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790773452.040952:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773452.041116:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790773452.041127:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141cea000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773452.041131:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790773452.041135:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496146304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773452.041394:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.041437:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.041462:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146432 00000100:00100000:0.0:1790773452.041466:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146432 00000100:00100000:0.0:1790773452.041498:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790773452.041504:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.041607:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146432:12345-0@lo:502:llog_process_th.0 Request processed in 103us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.041622:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790773452.041667:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.041680:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.041713:0:22714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.041742:0:22714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773452.041763:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146560 00000100:00100000:0.0:1790773452.041766:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146560 00000100:00100000:0.0:1790773452.041787:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773452.041793:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790773452.041848:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22714:x1877761496146560:12345-0@lo:502:llog_process_th.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.041855:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790773452.041881:0:22714:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.041892:0:22714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a65cda49-ef94-4b32-a3e4-9e24580a945a:22714:1877761496146560:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790773452.041908:0:22714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1790773452.043400:0:22662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790773452.043431:0:22662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773452.043459:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843391 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.043470:0:22662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3a00/0xabf1cc0bc784338a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843391 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790773452.043517:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790773452.043520:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790773452.043521:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773452.043522:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773452.043523:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773452.043524:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773452.043525:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773452.043527:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790773452.043529:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773452.043530:0:22662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773452.043538:0:22662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790773452.043540:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790773452.043541:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790773452.043542:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773452.043543:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773452.043543:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773452.043545:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773452.043545:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773452.043546:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790773452.043547:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773452.043548:0:22662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773452.043570:0:22662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790773452.043588:0:22662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496146688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790773452.043646:0:22662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.043687:0:22662:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.043709:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146688 00000100:00100000:3.0:1790773452.043716:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146688 00000100:00100000:3.0:1790773452.043762:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773452.043769:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22662:x1877761496146688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790773452.043797:0:22678:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790773452.043814:0:22678:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790773452.047406:0:22678:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790773452.047420:0:22678:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790773452.048566:0:22699:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773452.048574:0:22699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773452.048599:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.048619:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.048629:0:22699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.048687:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.048703:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773452.048718:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496146816:0@lo:104: 00000100:00100000:3.0:1790773452.048798:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773452.048852:0:22699:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d249659cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773452.048906:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146816 00000100:00100000:3.0:1790773452.048914:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146816 00000100:00100000:1.0:1790773452.049667:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22662:x1877761496146688:12345-0@lo:253:mount.lustre.0 Request processed in 5896us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773452.049681:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773452.050100:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773452.050112:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496146816:12345-0@lo:104: 00010000:00010000:3.0:1790773452.050129:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.050190:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773452.050196:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496146816:12345-0@lo:104: Request processed in 88us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773452.050216:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790773452.050228:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1790773452.050267:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496146816:0@lo:104: 00010000:00010000:1.0:1790773452.050303:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.050324:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773452.050328:0:22672:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.050337:0:22672:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773452.050344:0:22672:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773452.050350:0:22672:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1790773452.050378:0:22662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:22662:1877761496146688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790773452.050391:0:22662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790773452.050394:0:22662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790773452.050396:0:22662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790773452.050398:0:22662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773452.050398:0:22662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773452.050400:0:22662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773452.050401:0:22662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773452.050408:0:22662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790773452.050409:0:22662:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790773452.050411:0:22662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773452.050413:0:22662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790773452.050427:0:22662:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1790773452.050456:0:22672:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.050462:0:22672:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773452.050485:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.050492:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc784336e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843375 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.050510:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773452.050512:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773452.050514:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773452.050553:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790773452.050564:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496146944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773452.050598:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773452.050984:0:22699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773452.051503:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496146944 00000100:00100000:0.0:1790773452.051510:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496146944 00010000:00010000:0.0:1790773452.051533:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773452.051573:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773452.051582:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3607:x1877761496146944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773452.051586:0:22669:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1790773452.051594:0:22669:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1790773452.051595:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773452.051601:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051621:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051638:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784336e expref: 12 pid: 22677 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051650:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051656:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790773452.051666:0:22668:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003092635s 00010000:00010000:0.0:1790773452.051669:0:22668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051674:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051678:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051682:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051685:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773452.051688:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051693:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051705:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.051711:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773452.051750:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:3607:x1877761496146944:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.051758:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773452.051952:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496146944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773452.052045:0:22699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.052054:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773452.052066:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790773452.081200:0:22662:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1790773452.082431:0:22662:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790773452.084082:0:22724:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1790773452.084090:0:22724:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1790773452.084577:0:22725:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1790773452.085018:0:22725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1790773452.087121:0:22662:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1790773452.088696:0:22725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790773452.088793:0:22725:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1790773452.089332:0:22726:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff93d280f6f100 x1877761496147072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773452.089345:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000040:01000000:2.0:1790773452.090694:0:22662:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790773452.090755:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790773452.091483:0:22662:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790773452.091496:0:22662:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790773452.091528:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773452.092513:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790773452.093063:0:22662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790773452.093095:0:22662:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790773452.093968:0:22662:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1790773452.094642:0:22662:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1790773452.096032:0:22662:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790773452.097546:0:22662:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790773452.097592:0:22662:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb21f00e33988 00100000:10000000:3.0:1790773452.097601:0:22662:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790773452.098114:0:22662:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790773452.098129:0:22662:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790773452.098147:0:22662:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1790773452.098163:0:22662:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1790773452.101931:0:22662:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773452.102112:0:22662:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773452.623427:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790773452.813322:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773452.813331:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d24f7ba800 from 11 10000000:01000000:1.0:1790773452.813337:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773452.813382:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.813393:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.813403:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773452.813427:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496147200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773452.813495:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773452.813542:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.813804:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147200 00000100:00100000:0.0:1790773452.813815:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147200 00000100:00100000:0.0:1790773452.813874:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790773452.813883:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+11:22680:x1877761496147200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773452.813898:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773452.813911:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78433ad expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.813935:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.813957:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773452.813964:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d240030200, rc 0) 00000100:00100000:0.0:1790773452.814006:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22680:x1877761496147200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773452.814012:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790773452.814242:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496147200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773452.814376:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773452.814387:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773452.814442:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496147328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773452.814474:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773452.814542:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edad80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773452.818768:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147328 00000100:00100000:0.0:1790773452.818785:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147328 00000100:00100000:1.0:1790773452.822612:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790773452.822629:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22680:x1877761496147328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790773452.822659:0:22678:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790773452.822680:0:22678:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790773452.822684:0:22678:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790773452.822838:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:22680:x1877761496147328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 214us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773452.822847:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790773452.825900:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496147328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790773452.825987:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773452.825999:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773452.826011:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773453.074043:0:22719:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790773453.074070:0:22719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773453.087020:0:22719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1790773453.087035:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1790773453.133998:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:1.0:1790773453.647880:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773454.095191:0:22719:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790773454.095233:0:22719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773454.095488:0:22719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1790773454.095539:0:22719:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773454.095736:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1790773454.157860:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:2.0:1790773454.670360:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773455.182086:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:1.0:1790773455.697830:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773456.205414:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:2.0:1790773456.723944:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790773457.235341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790773457.235349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790773457.235353:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773457.235361:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:0.0:1790773457.235368:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773457.235380:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773457.235404:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e00e00 x1877761496147584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773457.235421:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773457.235448:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773457.235451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773457.235454:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773457.235457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790773457.235461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790773457.235462:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d141cea000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773457.235469:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d141cea000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773457.235482:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e00700 x1877761496147712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773457.235516:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773457.235538:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496147456:0@lo:400:kworker.0 00000100:00100000:0.0:1790773457.235644:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773457.235714:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496147584:0@lo:38:kworker.0 00000100:00100000:0.0:1790773457.235782:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773457.235801:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496147712:0@lo:38:kworker.0 00000100:00100000:0.0:1790773457.235847:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773457.235916:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147712 00000100:00100000:0.0:1790773457.235925:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147712 00000100:00100000:0.0:1790773457.235962:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773457.235971:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496147712:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790773457.236003:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:0.0:1790773457.236057:0:22685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xabf1cc0bc78433bb 00000004:00100000:0.0:1790773457.236074:0:22685:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790773457.236281:0:22685:0:(import.c:65:import_set_state_nolock()) ffff93d141ce9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773457.236345:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3603:x1877761496147712:12345-0@lo:38:kworker.0 Request processed in 373us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773457.236352:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790773457.236402:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d143e00700 x1877761496147712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773457.236417:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790773457.236439:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790773457.236443:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790773457.236445:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141cea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773457.236451:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3603:1877761496147712:0@lo:38:kworker.0 00000100:00100000:1.0:1790773457.236719:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147456 00000100:00100000:1.0:1790773457.236725:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147456 00000100:00100000:1.0:1790773457.236778:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773457.236787:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3606:x1877761496147456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773457.236837:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3606:x1877761496147456:12345-0@lo:400:kworker.0 Request processed in 51us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773457.236842:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790773457.236882:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147584 00000100:00100000:1.0:1790773457.236886:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147584 00000100:00100000:1.0:1790773457.236906:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773457.236910:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496147584:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790773457.236925:0:22689:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790773457.236957:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496147584:12345-0@lo:38:kworker.0 Request processed in 45us (1174us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790773457.236977:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773457.237010:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496147456:0@lo:400:kworker.0 00000100:00080000:1.0:1790773457.237034:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773457.237039:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790773457.237042:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496147584:0@lo:38:kworker.0 00000100:00100000:0.0:1790773457.240652:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000001:02000400:0.0:1790773457.447650:0:22969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790773457.745749:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773458.253518:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000020:00000004:2.0:1790773458.431546:0:23021:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773458.431769:0:23021:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773458.766633:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773459.282682:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000020:00000004:0.0:1790773459.496506:0:23071:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773459.496737:0:23071:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790773459.792609:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773460.301298:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:0.0:1790773460.817434:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773461.325318:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773451/real 1790773451] req@ffff93d280f6e680 x1877761496144512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773461.325355:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d280f6e680 x1877761496144512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773461.325388:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773461.325418:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773461.325422:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144512:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790773461.325659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790773461.325665:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773461.325680:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773461.325686:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 600 00000100:00080000:3.0:1790773461.325692:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790773461.325705:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773461.325733:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447ded80 x1877761496147968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773461.325746:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773461.325749:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790773461.325750:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773461.325753:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:3.0:1790773461.325755:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790773461.325759:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d143271800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773461.325771:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447de680 x1877761496148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773461.325780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773461.325784:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773461.326259:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496148224:0@lo:400:kworker.0 00000100:00100000:2.0:1790773461.326451:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773461.326520:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790773461.326528:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496147840:0@lo:400:kworker.0 00000100:00100000:2.0:1790773461.326560:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773461.326624:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147840 00000100:00100000:2.0:1790773461.326633:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147840 00000100:00100000:2.0:1790773461.326687:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773461.326696:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3605:x1877761496147840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773461.326754:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3605:x1877761496147840:12345-0@lo:400:kworker.0 Request processed in 58us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773461.326761:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773461.326796:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496147968:0@lo:38:kworker.0 00000100:00100000:3.0:1790773461.327079:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148224 00000100:00100000:3.0:1790773461.327085:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148224 00000100:00100000:3.0:1790773461.327115:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790773461.327122:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773461.327175:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496148224:12345-0@lo:400:kworker.0 Request processed in 54us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773461.327183:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773461.327977:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773461.328005:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148096:0@lo:8:kworker.0 00000400:00000100:2.0:1790773461.328031:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496148096 offset 0 length 520: 4 00000100:00100000:2.0:1790773461.328080:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496147840:0@lo:400:kworker.0 00010000:00080000:2.0:1790773461.328112:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d2447dea00 x1877761496148224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773461.328122:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496148224:0@lo:400:kworker.0 00000100:00100000:3.0:1790773461.328228:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147968 00000100:00100000:3.0:1790773461.328233:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147968 00000100:00100000:3.0:1790773461.328263:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773461.328269:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496147968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790773461.328286:0:22689:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790773461.328322:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496147968:12345-0@lo:38:kworker.0 Request processed in 52us (347us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773461.328329:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790773461.328466:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773461.328471:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773461.328475:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496147968:0@lo:38:kworker.0 00000100:00100000:0.0:1790773461.329095:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:1.0:1790773461.838294:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773462.353315:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773452/real 1790773452] req@ffff93d2447dca80 x1877761496144640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773462 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773462.353349:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d2447dca80 x1877761496144640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773462 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773462.353371:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773462.353392:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773462.353395:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496144640:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790773462.353460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790773462.353464:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790773462.353466:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773462.353472:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 604 00000100:00080000:2.0:1790773462.353478:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790773462.353490:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773462.353511:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c6d80 x1877761496148480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773462.353523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773462.353540:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773462.353545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773462.353548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790773462.353551:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773462.353556:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:2.0:1790773462.353560:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790773462.353569:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773462.353595:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c5180 x1877761496148608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773462.353651:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148480:0@lo:38:kworker.0 00000100:00100000:2.0:1790773462.353775:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773462.353822:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148608:0@lo:8:kworker.0 00000400:00000100:2.0:1790773462.353864:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496148608 offset 0 length 520: 4 00000100:00100000:2.0:1790773462.353935:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148480 00000100:00100000:2.0:1790773462.353946:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148480 00000100:00100000:2.0:1790773462.353995:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773462.354008:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496148480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790773462.354035:0:22689:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790773462.354096:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496148480:12345-0@lo:38:kworker.0 Request processed in 87us (320us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790773462.354105:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1790773462.354168:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773462.354174:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773462.354179:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148480:0@lo:38:kworker.0 00000100:00100000:1.0:1790773462.354391:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496148352:0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.354428:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773462.354449:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790773462.354458:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496148736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.354496:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773462.354546:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148352 00000100:00100000:1.0:1790773462.354552:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148352 00000100:00100000:1.0:1790773462.354751:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773462.354762:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3606:x1877761496148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.354825:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3606:x1877761496148352:12345-0@lo:400:kworker.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773462.354833:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790773462.354876:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148736 00000100:00100000:1.0:1790773462.354882:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148736 00000100:00100000:1.0:1790773462.354919:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790773462.354928:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.354992:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496148736:12345-0@lo:400:kworker.0 Request processed in 65us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773462.355000:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790773462.355057:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d1444c5f80 x1877761496148736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773462.355071:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496148736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.355086:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496148352:0@lo:400:kworker.0 00000100:00100000:1.0:1790773462.358711:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:0.0:1790773462.861315:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773463.377285:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:1.0:1790773463.885515:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773464.336410:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773464.399643:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:0.0:1790773464.909467:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773465.421284:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:2.0:1790773465.934804:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773466.470414:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:0.0:1790773466.958973:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773467.469315:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000100:00080000:3.0:1790773467.471850:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790773467.471855:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773467.471858:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773467.471865:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 605 00000100:00080000:3.0:1790773467.471869:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790773467.471878:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773467.471897:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dd500 x1877761496148992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773467.471909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773467.471911:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773467.471913:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773467.471916:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773467.471939:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496149120:0@lo:400:kworker.0 00000100:00100000:3.0:1790773467.471997:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.472058:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773467.472063:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496148864:0@lo:400:kworker.0 00000100:00100000:3.0:1790773467.472105:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.472143:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148992:0@lo:38:kworker.0 00000100:00100000:3.0:1790773467.472190:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.472251:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149120 00000100:00100000:3.0:1790773467.472259:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149120 00000100:00100000:3.0:1790773467.472296:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773467.472302:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773467.472341:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496149120:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.472347:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773467.472365:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148864 00000100:00100000:3.0:1790773467.472368:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148864 00000100:00100000:3.0:1790773467.472383:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773467.472387:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3605:x1877761496148864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773467.472405:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:3605:x1877761496148864:12345-0@lo:400:kworker.0 Request processed in 18us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.472409:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773467.472427:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496148992 00000100:00100000:3.0:1790773467.472429:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496148992 00000100:00100000:3.0:1790773467.472441:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773467.472444:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496148992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790773467.472456:0:22689:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790773467.472477:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496148992:12345-0@lo:38:kworker.0 Request processed in 32us (287us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773467.472480:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790773467.472509:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773467.472513:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790773467.472516:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148992:0@lo:38:kworker.0 00000100:00100000:3.0:1790773467.472542:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496148864:0@lo:400:kworker.0 00010000:00080000:3.0:1790773467.472549:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d2447dc000 x1877761496149120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773467.472557:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496149120:0@lo:400:kworker.0 00000020:01000004:0.0:1790773467.696257:0:23416:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790773467.696262:0:23416:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1790773467.696264:0:23416:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790773467.696374:0:23416:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d14482b000 00000020:01000004:0.0:1790773467.696394:0:23416:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1790773467.696406:0:23416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790773467.696421:0:23416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff93d26ec24d40) 00000020:00000080:0.0:1790773467.696438:0:23416:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1790773467.759478:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.763577:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790773467.767910:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.768377:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.768802:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.769068:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.769872:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.770095:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.770476:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.770950:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.771332:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.771672:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.771944:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.772292:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.772550:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.772842:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.773238:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.773480:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.773764:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.774267:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.774536:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.774806:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.775144:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.775541:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.775847:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.776051:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.776606:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.777056:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.777373:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.777578:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.777871:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.778186:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.778506:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1790773467.778901:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1790773467.781380:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.781632:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.782346:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790773467.783050:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790773467.783438:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790773467.783726:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.784055:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1790773467.784400:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1790773467.784617:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.784984:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.785341:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790773467.785667:0:23416:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:1.0:1790773467.786645:0:23416:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773467.786914:0:23416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1790773467.786928:0:23416:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773467.786942:0:23416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc78433c9 00000020:01000004:1.0:1790773467.786949:0:23416:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1790773467.786976:0:23416:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790773467.786981:0:23416:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790773467.786988:0:23416:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1790773467.787020:0:23416:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1790773467.787025:0:23416:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1790773467.792839:0:23416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790773467.792892:0:23416:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1790773467.792898:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790773467.792900:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790773467.792902:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773467.792903:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773467.792904:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773467.792905:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773467.792906:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790773467.792909:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773467.792910:0:23416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790773467.792915:0:23416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1790773467.792917:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790773467.792919:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790773467.792920:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773467.792921:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773467.792922:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773467.792923:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773467.792926:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790773467.792932:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773467.792933:0:23416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790773467.792968:0:23416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1790773467.792995:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790773467.793081:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.793832:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680180 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.793893:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149248 00000100:00100000:1.0:1790773467.793903:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149248 00000100:00100000:1.0:1790773467.793972:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773467.793984:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:23416:x1877761496149248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790773467.794025:0:22677:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1790773467.794028:0:22677:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1790773467.794039:0:22677:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1790773467.794695:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:23416:x1877761496149248:12345-0@lo:253:mount.lustre.0 Request processed in 710us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.794705:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790773467.794808:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790773467.794823:0:23416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1790773467.794826:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790773467.794827:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1790773467.794829:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773467.794830:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773467.794831:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773467.794832:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773467.794833:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790773467.794835:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773467.794837:0:23416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790773467.794858:0:23416:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d14482b000 from lustre-MDT0001 10000000:01000000:0.0:1790773467.794897:0:23416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1790773467.794901:0:23416:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790773467.794911:0:23416:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d26bfc19c0 local copy 00010000:00010000:0.0:1790773467.794922:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.795041:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773467.795076:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.795129:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.795442:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149376 00000100:00100000:1.0:1790773467.795448:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149376 00000100:00100000:1.0:1790773467.795679:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773467.795698:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:23416:x1877761496149376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773467.795796:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:23416:x1877761496149376:12345-0@lo:501:mount.lustre.0 Request processed in 99us (719us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790773467.795804:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790773467.795873:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149376:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790773467.795887:0:23416:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790773467.795908:0:23416:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790773467.795915:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.795964:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.795988:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d14482b000 10000000:01000000:0.0:1790773467.795993:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790773467.795998:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93d26bfc19c0 10000000:01000000:0.0:1790773467.796000:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790773467.796004:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93d26bfc19c0 from 1 10000000:01000000:0.0:1790773467.796007:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790773467.796034:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.796042:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.796051:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.796066:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773467.796103:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.797104:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773467.797252:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149504 00000100:00100000:3.0:1790773467.797261:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149504 00000100:00100000:3.0:1790773467.797305:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790773467.797314:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+12:23416:x1877761496149504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773467.797329:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773467.797346:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3c00/0xabf1cc0bc78433d7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78433d0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.797370:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3c00/0xabf1cc0bc78433d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78433d0 expref: 13 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.797380:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3c00/0xabf1cc0bc78433d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78433d0 expref: 13 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.797388:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3c00, rc 0) 00000100:00100000:3.0:1790773467.797440:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+13:23416:x1877761496149504:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.797447:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790773467.797546:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.797564:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433d7 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.797574:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78433d7 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.797625:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790773467.797642:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433d7 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.797648:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5600/0xabf1cc0bc78433d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433d7 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.797659:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d14482b000 10000000:01000000:0.0:1790773467.797663:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790773467.797668:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d14482b000 from 1 10000000:01000000:0.0:1790773467.797671:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790773467.797693:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.797701:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.797709:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.797725:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773467.797756:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.797772:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773467.798001:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149632 00000100:00100000:3.0:1790773467.798006:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149632 00000100:00100000:3.0:1790773467.798028:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790773467.798033:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+13:23416:x1877761496149632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773467.798050:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773467.798059:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78433de expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.798076:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78433de expref: 14 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.798095:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3200/0xabf1cc0bc78433e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78433de expref: 14 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.798102:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3200, rc 0) 00000100:00100000:3.0:1790773467.798248:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+14:23416:x1877761496149632:12345-0@lo:101:mount.lustre.0 Request processed in 213us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.798255:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773467.798372:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.798386:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433e5 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.798394:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78433e5 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.798412:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790773467.798417:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433e5 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.798423:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5000/0xabf1cc0bc78433de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433e5 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.798429:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790773467.798433:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773467.798439:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d14482b000 10000000:01000000:0.0:1790773467.798442:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790773467.798445:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790773467.798446:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790773467.798463:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.798470:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.798478:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.798491:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773467.798519:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.798542:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.798680:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149760 00000100:00100000:1.0:1790773467.798687:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149760 00000100:00100000:1.0:1790773467.798713:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790773467.798721:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+14:23416:x1877761496149760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773467.798729:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773467.798738:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78433f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78433ec expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.798752:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78433f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78433ec expref: 15 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.798761:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b000/0xabf1cc0bc78433f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78433ec expref: 15 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.798768:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b000, rc 0) 00000100:00100000:1.0:1790773467.798873:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496149760:12345-0@lo:101:mount.lustre.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.798880:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773467.798970:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.798980:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433f3 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.798994:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78433f3 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773467.800737:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1790773467.801576:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773467.807381:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1790773467.807442:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1790773467.807457:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1790773467.807470:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1790773467.807483:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1790773467.807495:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1790773467.807508:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1790773467.807520:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1790773467.807534:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1790773467.807546:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1790773467.807558:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1790773467.807573:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1790773467.807586:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1790773467.807684:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1790773467.807705:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1790773467.807725:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1790773467.807741:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1790773467.807755:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1790773467.807768:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1790773467.807860:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1790773467.807878:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1790773467.807894:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1790773467.807908:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1790773467.807924:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1790773467.807940:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1790773467.807956:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1790773467.807987:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1790773467.808003:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1790773467.808016:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1790773467.808028:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1790773467.808039:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1790773467.808050:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1790773467.808064:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1790773467.808079:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1790773467.808106:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1790773467.808193:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1790773467.808256:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1790773467.808274:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1790773467.808289:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1790773467.808303:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1790773467.808315:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1790773467.808327:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1790773467.808340:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1790773467.808354:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1790773467.808386:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1790773467.808392:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1790773467.808529:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773467.808848:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.808929:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.808974:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496149888 00000100:00100000:1.0:1790773467.808982:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496149888 00000100:00100000:1.0:1790773467.809080:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790773467.809098:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496149888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773467.809403:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496149888:12345-0@lo:501:mount.lustre.0 Request processed in 306us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.809425:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773467.809541:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496149888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773467.809576:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773467.809631:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.810252:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150016 00000100:00100000:3.0:1790773467.810258:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150016 00000100:00100000:3.0:1790773467.810291:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790773467.810298:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773467.811372:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773467.813578:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150016:12345-0@lo:503:mount.lustre.0 Request processed in 3268us (3934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.813606:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790773467.813896:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773467.814713:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773467.814904:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773467.814982:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.815091:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.815277:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150144 00000100:00100000:1.0:1790773467.815285:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150144 00000100:00100000:1.0:1790773467.815387:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773467.815399:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773467.816308:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150144:12345-0@lo:502:mount.lustre.0 Request processed in 906us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.816320:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790773467.816448:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773467.816686:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1790773467.816718:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1790773467.816740:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1790773467.816757:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1790773467.816774:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1790773467.816804:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1790773467.816819:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1790773467.816832:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1790773467.816846:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1790773467.816857:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1790773467.816868:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1790773467.816881:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1790773467.816894:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1790773467.816906:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1790773467.816920:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1790773467.816931:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1790773467.816944:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1790773467.816956:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1790773467.816966:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1790773467.816980:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1790773467.816992:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1790773467.817004:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1790773467.817017:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1790773467.817029:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1790773467.817041:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1790773467.817054:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1790773467.817067:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1790773467.817107:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1790773467.817284:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1790773467.817305:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1790773467.817319:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1790773467.817333:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1790773467.817346:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1790773467.817358:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1790773467.817371:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1790773467.817384:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1790773467.817397:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1790773467.817411:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1790773467.817425:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1790773467.817439:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1790773467.817453:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1790773467.817468:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1790773467.817481:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1790773467.817497:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1790773467.817538:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773467.817664:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.818134:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773467.818319:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150272 00000100:00100000:3.0:1790773467.818329:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150272 00000100:00100000:3.0:1790773467.818373:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790773467.818382:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773467.818507:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150272:12345-0@lo:502:mount.lustre.0 Request processed in 125us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.818524:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790773467.818641:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773467.818701:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1790773467.818712:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1790773467.819799:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773467.819813:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.819815:0:23420:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790773467.819822:0:23420:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1790773467.819826:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773467.819843:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff93d26ec219c0) 00000020:00000080:0.0:1790773467.819865:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1790773467.819871:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1790773467.819957:0:23420:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790773467.819964:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7843401 00000020:00000080:0.0:1790773467.820264:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1790773467.820269:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773467.820273:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.820275:0:23420:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1790773467.820278:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773467.820282:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.820283:0:23420:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1790773467.820287:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773467.820294:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff93d26ec20000) 00000020:00000080:0.0:1790773467.820305:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1790773467.820309:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1790773467.820311:0:23420:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1790773467.820314:0:23420:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1790773467.820319:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790773467.820366:0:23420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14482b000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1790773467.820379:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff93d279ea19c0) 00000020:00000080:0.0:1790773467.820388:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1790773467.820463:0:23420:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1790773467.820470:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7843416 00000020:00000080:0.0:1790773467.820553:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1790773467.820559:0:23420:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1790773467.820563:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xabf1cc0bc784341d 00080000:01000000:0.0:1790773467.820567:0:23420:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:0.0:1790773467.820569:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7843424 00010000:00010000:2.0:1790773467.905426:0:23420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1790773467.908871:0:23420:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1790773467.909567:0:23420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790773467.911237:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1790773467.911255:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.911262:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.911265:0:23420:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1790773467.911276:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.911283:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.911285:0:23420:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1790773467.911288:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773467.911295:0:23420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:00000080:3.0:1790773467.911332:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773467.911355:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff93d27b2c19c0) 00000020:00000080:3.0:1790773467.911380:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1790773467.911386:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773467.911458:0:23420:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1790773467.911481:0:23420:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790773467.911490:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7843432 00010000:00080000:3.0:1790773467.911527:0:23420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d243ec9800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773467.913334:0:23420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1790773467.926276:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1790773467.926304:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1790773467.926367:0:23420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790773467.926396:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7843439 00000100:00080000:3.0:1790773467.926408:0:23420:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773467.926421:0:23420:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff93d243ec9800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773467.926457:0:23420:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dc000 x1877761496150400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773467.926619:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773467.926725:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790773467.926903:0:23420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1790773467.926986:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.927002:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927004:0:23420:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1790773467.927008:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790773467.927013:0:23420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790773467.927015:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773467.927017:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773467.927018:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790773467.927021:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927023:0:23420:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790773467.927026:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.927032:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927033:0:23420:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1790773467.927038:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790773467.927095:0:23420:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790773467.927110:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.927113:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927115:0:23420:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1790773467.927118:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790773467.927120:0:23420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1790773467.927121:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773467.927123:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790773467.927125:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790773467.927128:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927129:0:23420:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790773467.927132:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790773467.927136:0:23420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1790773467.927140:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.927142:0:23420:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790773467.927145:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790773467.927150:0:23420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1790773467.927189:0:23420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1790773467.927193:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790773467.927236:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff93d27b2c3380) 00000020:00000080:3.0:1790773467.927255:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1790773467.927269:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790773467.927342:0:23420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1790773467.927349:0:23420:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790773467.927357:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7843447 00010000:00080000:3.0:1790773467.927393:0:23420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143c86800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773467.928243:0:23420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1790773467.932418:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1790773467.932894:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150400 00000100:00100000:2.0:1790773467.932907:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150400 00000100:00100000:2.0:1790773467.932953:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773467.932961:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496150400:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790773467.932993:0:22689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:2.0:1790773467.933041:0:22689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc784344e 00000004:00100000:2.0:1790773467.933060:0:22689:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1790773467.933067:0:22689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1790773467.933350:0:23420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1790773467.935824:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773467.935832:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773467.935835:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773467.935837:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1790773467.937091:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773467.937515:0:23420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1790773467.937880:0:23420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1790773467.939503:0:23425:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790773467.939511:0:23425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790773467.940536:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773467.940551:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790773467.940663:0:23420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790773467.940690:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7843455 00000100:00080000:0.0:1790773467.940702:0:23420:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773467.940714:0:23420:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d143c86800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773467.940752:0:23420:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e00700 x1877761496150528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773467.942061:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150528:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1790773467.942143:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496150528 offset 0 length 520: 4 00000100:00080000:0.0:1790773467.942810:0:23420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790773467.942904:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773467.942912:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.942914:0:23420:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790773467.942917:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790773467.942920:0:23420:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1790773467.942922:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773467.942923:0:23420:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773467.942925:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790773467.942927:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.942929:0:23420:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790773467.942932:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790773467.942937:0:23420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790773467.942941:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.942942:0:23420:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790773467.942945:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790773467.942949:0:23420:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1790773467.942973:0:23420:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790773467.942975:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773467.942991:0:23420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff93d279ea3380) 00000020:00000080:0.0:1790773467.943012:0:23420:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1790773467.943018:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790773467.943107:0:23420:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1790773467.943114:0:23420:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790773467.943120:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xabf1cc0bc7843463 00010000:00080000:0.0:1790773467.943329:0:23420:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d281bd7000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773467.943576:0:23420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1790773467.944098:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790773467.944271:0:23420:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1790773467.944712:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773467.944718:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773467.944721:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773467.944724:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1790773467.947756:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773467.948381:0:23420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1790773467.948519:0:23420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1790773467.949161:0:23427:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790773467.949173:0:23427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1790773467.950094:0:23420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790773467.950107:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790773467.950364:0:23420:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1790773467.950388:0:23420:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc784346a 00000100:00080000:0.0:1790773467.950398:0:23420:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773467.950408:0:23420:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773467.950441:0:23420:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e00000 x1877761496150656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773467.950569:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150656:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790773467.950687:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496150656 offset 0 length 520: 4 00000100:00080000:0.0:1790773467.950741:0:23420:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1790773467.950807:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773467.950811:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.950813:0:23420:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1790773467.950815:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773467.950819:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.950821:0:23420:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790773467.950824:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790773467.950826:0:23420:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790773467.950828:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773467.950830:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.950831:0:23420:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790773467.950833:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773467.950835:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.950836:0:23420:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790773467.950839:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790773467.950865:0:23420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773467.950868:0:23420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773467.950869:0:23420:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790773467.950872:0:23420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1790773467.951412:0:23416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1790773467.951446:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1790773467.951479:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433f3 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.951491:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5800/0xabf1cc0bc78433ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78433f3 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773467.951500:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14482b000 from 1 10000000:01000000:3.0:1790773467.951502:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790773467.951535:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.951542:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.951569:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773467.951587:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773467.951644:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.951684:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626800c0 going to sleep for 11 seconds 00000100:00080000:3.0:1790773467.951703:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773467.951708:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773467.951710:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773467.951713:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773467.951842:0:22689:0:(import.c:65:import_set_state_nolock()) ffff93d143c85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773467.952030:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150784 00000100:00100000:1.0:1790773467.952038:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150784 00000100:00100000:1.0:1790773467.952095:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790773467.952104:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+15:23416:x1877761496150784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773467.952116:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773467.952128:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843471 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.952152:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 16 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.952162:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 16 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773467.952183:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773467.952248:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:23416:x1877761496150784:12345-0@lo:101:mount.lustre.0 Request processed in 145us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.952255:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790773467.953042:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496150400:12345-0@lo:38:llog_process_th.0 Request processed in 20076us (26312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.953053:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773467.953127:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773467.953150:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773467.953162:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773467.953976:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150912:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790773467.954032:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.954061:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2626800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773467.954547:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496150912 00000100:00100000:1.0:1790773467.954563:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496150912 00000100:00100000:1.0:1790773467.954623:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790773467.954631:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:23416:x1877761496150912:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790773467.954652:0:22677:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790773467.954670:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790773467.954673:0:22677:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790773467.954937:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:23416:x1877761496150912:12345-0@lo:256:mount.lustre.0 Request processed in 306us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773467.954946:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773467.955032:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496150912:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790773467.955712:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773467.955732:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.955744:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.955754:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14482b000 from 1 10000000:01000000:0.0:1790773467.955757:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773467.956060:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.956070:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.956081:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.956111:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773467.956341:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.956378:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818600 going to sleep for 11 seconds 00000100:00100000:0.0:1790773467.956422:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151040 00000100:00100000:0.0:1790773467.956429:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151040 00000100:00100000:0.0:1790773467.956576:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773467.956586:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:23416:x1877761496151040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.956662:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773467.956676:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784347f expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.956720:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.956732:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.956741:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4a00, rc 0) 00000100:00100000:0.0:1790773467.956936:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151040:12345-0@lo:101:mount.lustre.0 Request processed in 350us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773467.956943:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773467.957000:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.957018:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.957026:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773467.959068:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000100:00100000:2.0:1790773467.959311:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773467.959325:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790773467.959333:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790773467.959339:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790773467.959344:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d243ec9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1790773467.959738:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773467.959944:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790773467.959973:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1790773467.959988:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1790773467.960005:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1790773467.960018:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1790773467.960034:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1790773467.960049:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1790773467.960065:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1790773467.960080:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790773467.960130:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1790773467.960149:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000100:00100000:2.0:1790773467.960493:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150400:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790773467.960753:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1790773467.960763:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1790773467.960871:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773467.960937:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.960976:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773467.961100:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151168 00000100:00100000:2.0:1790773467.961109:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151168 00000100:00100000:2.0:1790773467.961181:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773467.961190:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773467.961371:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151168:12345-0@lo:501:mount.lustre.0 Request processed in 181us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773467.961379:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790773467.961432:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773467.961479:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773467.961522:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773467.961537:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773467.961807:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151296 00000100:00100000:3.0:1790773467.961812:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151296 00000100:00100000:3.0:1790773467.961846:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790773467.961853:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773467.961939:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151296:12345-0@lo:503:mount.lustre.0 Request processed in 86us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.961947:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790773467.962295:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790773467.963061:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790773467.964058:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773467.964943:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773467.965046:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773467.965377:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773467.965588:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151424 00000100:00100000:3.0:1790773467.965668:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151424 00000100:00100000:3.0:1790773467.965791:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790773467.965803:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773467.966053:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151424:12345-0@lo:502:mount.lustre.0 Request processed in 252us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773467.966062:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790773467.966354:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496151552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773467.966393:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773467.966427:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151552 00000100:00100000:2.0:1790773467.966431:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151552 00000100:00100000:2.0:1790773467.966476:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773467.966484:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496151552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773467.966513:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790773467.966557:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496151552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773467.966564:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773467.966625:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496151552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773467.967043:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773467.967730:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790773467.967770:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1790773467.967927:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1790773467.967944:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1790773467.967960:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1790773467.967975:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1790773467.967990:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1790773467.968004:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1790773467.968018:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790773467.968033:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1790773467.968066:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1790773467.968358:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773467.968427:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.968579:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27d818cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773467.968673:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151680 00000100:00100000:2.0:1790773467.968682:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151680 00000100:00100000:2.0:1790773467.968766:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773467.968784:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773467.968898:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151680:12345-0@lo:502:mount.lustre.0 Request processed in 124us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773467.968906:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790773467.968974:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773467.969022:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1790773467.969031:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1790773467.970002:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.970013:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970016:0:23429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790773467.970023:0:23429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14482b000 00000020:00000080:3.0:1790773467.970026:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773467.970032:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.970034:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970036:0:23429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790773467.970038:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.970040:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970041:0:23429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790773467.970044:0:23429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d14482b000 00000020:00000080:3.0:1790773467.970046:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773467.970111:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.970114:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970121:0:23429:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790773467.970130:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.970132:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970134:0:23429:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773467.970137:0:23429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14482b000 00000020:00000080:3.0:1790773467.970139:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773467.970156:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.970158:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970160:0:23429:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790773467.970169:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790773467.970172:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970173:0:23429:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1790773467.970176:0:23429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d14482b000 00000020:00000080:3.0:1790773467.970178:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790773467.970197:0:23429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790773467.970200:0:23429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790773467.970201:0:23429:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1790773467.970229:0:23429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1790773467.977525:0:23416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790773467.977578:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773467.977596:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.977619:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773467.977682:0:23416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790773467.977686:0:23416:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d14482b000 10000000:01000000:0.0:1790773467.977689:0:23416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d14482b000 10000000:01000000:0.0:1790773467.977694:0:23416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773467.977700:0:23416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d14482b000 from 1 10000000:01000000:0.0:1790773467.977703:0:23416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773467.977740:0:23416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.977749:0:23416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.977761:0:23416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773467.977787:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773467.977855:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.977899:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d262680f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773467.977923:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151808 00000100:00100000:0.0:1790773467.977929:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151808 00000100:00100000:0.0:1790773467.977969:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773467.977977:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:23416:x1877761496151808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.977990:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773467.978005:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d2532e5400/0xabf1cc0bc7843494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784348d expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.978039:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d2532e5400/0xabf1cc0bc7843494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784348d expref: 18 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.978049:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d2532e5400/0xabf1cc0bc7843494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784348d expref: 18 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.978058:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e5400, rc 0) 00000100:00100000:0.0:1790773467.978120:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496151808:12345-0@lo:101:mount.lustre.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773467.978128:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773467.978184:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773467.978199:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843494 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773467.978236:0:23416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843494 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773467.979841:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1790773467.980159:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773467.981019:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1790773467.981055:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1790773467.981103:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1790773467.981125:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1790773467.981143:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1790773467.981160:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1790773467.981175:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1790773467.981189:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1790773467.981945:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1790773467.984741:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1790773467.985005:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1790773467.985030:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1790773467.985046:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1790773467.985062:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1790773467.985078:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1790773467.985105:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1790773467.985121:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1790773467.985161:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1790773467.985176:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1790773467.985189:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00010000:00010000:2.0:1790773467.985404:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773467.987313:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1790773467.987380:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1790773467.987401:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1790773467.987416:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1790773467.987435:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1790773467.987452:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1790773467.987467:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1790773467.987482:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1790773467.987499:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1790773467.987512:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1790773467.987544:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1790773467.987561:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1790773467.987575:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1790773467.987591:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1790773467.987607:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1790773467.987620:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1790773467.987633:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1790773467.987648:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1790773467.987661:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1790773467.987678:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1790773467.987693:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1790773467.987708:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1790773467.987727:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1790773467.987746:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1790773467.987764:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1790773467.987890:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1790773467.987929:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1790773467.987945:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1790773467.988144:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1790773467.988169:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1790773467.988189:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1790773467.988196:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1790773467.988427:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773467.988509:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773467.988887:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c1449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773467.998068:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496151936 00000100:00100000:2.0:1790773467.998094:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496151936 00000100:00100000:2.0:1790773467.998148:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790773467.998160:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496151936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773467.998370:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496151936:12345-0@lo:501:mount.lustre.0 Request processed in 212us (9860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773467.998388:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790773467.998434:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496151936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773467.998519:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773467.998586:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773467.998641:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773468.005624:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152064 00000100:00100000:1.0:1790773468.005655:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152064 00000100:00100000:1.0:1790773468.005725:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773468.005736:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773468.006129:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152064:12345-0@lo:503:mount.lustre.0 Request processed in 394us (7542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.006137:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790773468.006816:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773468.007356:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773468.007474:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773468.007551:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773468.007614:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773468.008188:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152192 00000100:00100000:2.0:1790773468.008200:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152192 00000100:00100000:2.0:1790773468.008294:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773468.008305:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773468.008462:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152192:12345-0@lo:502:mount.lustre.0 Request processed in 158us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773468.008470:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790773468.009577:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773468.010127:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1790773468.010166:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1790773468.010180:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1790773468.010194:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1790773468.010246:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1790773468.010265:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1790773468.010279:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1790773468.010292:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1790773468.010321:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1790773468.010335:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1790773468.010349:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1790773468.010361:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1790773468.010373:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1790773468.010385:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1790773468.010399:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1790773468.010411:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1790773468.010424:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1790773468.010436:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1790773468.010466:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1790773468.010478:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1790773468.010492:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1790773468.010513:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1790773468.010526:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1790773468.010540:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1790773468.010567:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1790773468.010583:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1790773468.010608:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1790773468.010625:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1790773468.013231:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1790773468.013271:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1790773468.013287:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1790773468.013301:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1790773468.013314:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1790773468.013327:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1790773468.013340:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1790773468.013352:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1790773468.013364:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1790773468.013379:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1790773468.013418:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1790773468.013431:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1790773468.013443:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1790773468.013455:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1790773468.013467:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1790773468.013478:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1790773468.013490:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1790773468.013501:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1790773468.013513:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1790773468.013526:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1790773468.014453:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773468.014563:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773468.014646:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14780 going to sleep for 11 seconds 00000100:00100000:2.0:1790773468.015103:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152320 00000100:00100000:2.0:1790773468.015115:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152320 00000100:00100000:2.0:1790773468.015184:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790773468.015195:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773468.015371:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152320:12345-0@lo:502:mount.lustre.0 Request processed in 178us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773468.015379:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773468.015501:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773468.015755:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1790773468.015965:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1790773468.016002:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773468.016044:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773468.016095:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773468.016187:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152448 00000100:00100000:3.0:1790773468.016192:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152448 00000100:00100000:3.0:1790773468.016247:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773468.016255:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773468.016341:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152448:12345-0@lo:502:mount.lustre.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773468.016349:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790773468.016405:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773468.016446:0:23416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1790773468.016455:0:23416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1790773468.022404:0:23435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1790773468.022426:0:23435:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff93d279ea0000) 00000020:00000080:0.0:1790773468.022454:0:23435:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1790773468.022557:0:23435:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d14482b000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790773468.022563:0:23435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d14482b000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1790773468.022565:0:23435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d14482b000 3 00010000:00080000:0.0:1790773468.022614:0:23435:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d141fee800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1790773468.024301:0:23435:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1790773468.024543:0:23435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1790773468.024596:0:23435:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790773468.024610:0:23435:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xabf1cc0bc78434a2 00000100:00080000:0.0:1790773468.024625:0:23435:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790773468.024640:0:23435:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff93d141fee800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773468.024688:0:23435:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e00380 x1877761496152576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773468.024711:0:23435:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790773468.025554:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773468.025561:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773468.025564:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773468.025567:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773468.025788:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496152576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790773468.025870:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773468.026426:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152576 00000100:00100000:1.0:1790773468.026436:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152576 00000100:00100000:1.0:1790773468.026486:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790773468.026493:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3603:x1877761496152576:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790773468.026522:0:22684:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 610 last 0 00000020:00000080:1.0:1790773468.026559:0:22684:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xabf1cc0bc78434a9 00000004:00100000:1.0:1790773468.026579:0:22684:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790773468.026643:0:22684:0:(import.c:65:import_set_state_nolock()) ffff93d14482e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773468.026707:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3603:x1877761496152576:12345-0@lo:38:llog_process_th.0 Request processed in 213us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.026715:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790773468.026768:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143e00380 x1877761496152576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773468.026791:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790773468.026800:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790773468.026807:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790773468.026811:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790773468.026813:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d141fee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790773468.026819:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3603:1877761496152576:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790773468.032318:0:23435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1790773468.032589:0:23416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790773468.032639:0:23416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790773468.032654:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843494 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.032667:0:23416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e4800/0xabf1cc0bc784348d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843494 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790773468.032721:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790773468.032723:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790773468.032724:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773468.032726:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773468.032727:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773468.032729:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773468.032730:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773468.032732:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773468.032733:0:23416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773468.032737:0:23416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1790773468.032740:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790773468.032742:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790773468.032743:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773468.032744:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773468.032745:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773468.032746:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773468.032747:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790773468.032748:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773468.032749:0:23416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790773468.032793:0:23416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790773468.032820:0:23416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790773468.032909:0:23416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773468.032953:0:23416:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251f190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773468.032977:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152704 00000100:00100000:3.0:1790773468.032985:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152704 00000100:00100000:3.0:1790773468.033032:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773468.033041:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790773468.033079:0:22678:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790773468.033107:0:22678:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1790773468.038310:0:22663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1790773468.038393:0:22678:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790773468.038405:0:22678:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790773468.038733:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:23416:x1877761496152704:12345-0@lo:253:mount.lustre.0 Request processed in 5686us (5819us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773468.038749:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790773468.038976:0:23416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:23416:1877761496152704:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790773468.038993:0:23416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790773468.038997:0:23416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773468.038999:0:23416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790773468.039000:0:23416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773468.039002:0:23416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773468.039004:0:23416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773468.039005:0:23416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773468.039006:0:23416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790773468.039021:0:23416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773468.039023:0:23416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790773468.039040:0:23416:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1790773468.041513:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1790773468.041621:0:23440:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790773468.041626:0:23440:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 20000000:01000000:3.0:1790773468.041780:0:22699:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773468.041787:0:22699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773468.041810:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.041830:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.041839:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 17 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.041847:0:22699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.041886:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 17 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.041901:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 17 pid: 22676 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.041915:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496152832:0@lo:104: 00000100:00100000:3.0:1790773468.041979:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773468.042031:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042039:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 17 pid: 22677 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.042048:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496152960:0@lo:104: 00000100:00100000:3.0:1790773468.042078:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773468.042110:0:22699:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251f19e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773468.042141:0:22667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152832 00000100:00100000:3.0:1790773468.042147:0:22667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152832 00000100:00100000:3.0:1790773468.042180:0:22667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496152960 00000100:00100000:3.0:1790773468.042182:0:22667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496152960 00000100:00100000:3.0:1790773468.042195:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773468.042226:0:22667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496152832:12345-0@lo:104: 00010000:00010000:3.0:1790773468.042241:0:22667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042294:0:22667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773468.042300:0:22667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496152832:12345-0@lo:104: Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773468.042308:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773468.042328:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773468.042334:0:22667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496152960:12345-0@lo:104: 00010000:00010000:3.0:1790773468.042342:0:22667:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042387:0:22667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773468.042393:0:22667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496152960:12345-0@lo:104: Request processed in 59us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773468.042399:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1790773468.042419:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773468.042425:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042433:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773468.042444:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042453:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773468.042461:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773468.042466:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773468.042495:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042502:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773468.042524:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042532:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2000/0xabf1cc0bc7843471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843478 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042547:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773468.042550:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042556:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b800 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773468.042559:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042566:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773468.042582:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773468.042588:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790773468.042602:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042608:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773468.042625:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042631:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b800/0xabf1cc0bc78433ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78433b4 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042643:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773468.042644:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773468.042646:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773468.042652:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773468.042669:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496153088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773468.042700:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773468.042737:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496153216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773468.042761:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773468.042796:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153088 00000100:00100000:3.0:1790773468.042800:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153088 00010000:00010000:3.0:1790773468.042818:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 18 pid: 22676 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.042837:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153216 00000100:00100000:3.0:1790773468.042847:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153216 00010000:00010000:3.0:1790773468.042860:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 19 pid: 22677 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.042881:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773468.042887:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:3607:x1877761496153088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773468.042898:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773468.042903:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 19 pid: 22676 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042912:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 19 pid: 22676 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042926:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773468.042954:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:3607:x1877761496153088:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773468.042960:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773468.042971:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773468.042977:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3604:x1877761496153216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773468.042984:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773468.042988:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 18 pid: 22677 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.042997:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 18 pid: 22677 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043008:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043016:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790773468.043039:0:22668:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003092635s 00010000:00010000:3.0:1790773468.043043:0:22668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043050:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043057:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043064:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043069:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3e00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773468.043072:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.043080:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1790773468.043378:0:23441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790773468.043400:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1790773468.044927:0:23441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1790773468.045914:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.045930:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773468.046030:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3604:x1877761496153216:12345-0@lo:103:ldlm_bl.0 Request processed in 3048us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773468.046043:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773468.046176:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496153216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773468.046231:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496153088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773468.046280:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7843471 expref: 17 pid: 22676 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.046296:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496152832:0@lo:104: 00010000:00010000:3.0:1790773468.046307:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d240030200/0xabf1cc0bc78433b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78433ad expref: 16 pid: 22677 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773468.046315:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496152960:0@lo:104: 00010000:00010000:3.0:1790773468.046328:0:22699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.046338:0:22699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.046344:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773468.046351:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773468.047881:0:23442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.047956:0:23442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773468.047995:0:23442:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b600 going to sleep for 11 seconds 00000040:01000000:3.0:1790773468.048385:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1790773468.048425:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773468.048842:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153344 00000100:00100000:1.0:1790773468.048853:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153344 00000100:00100000:1.0:1790773468.048912:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773468.048925:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.049068:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.049076:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773468.049142:0:23442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153344:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1790773468.049183:0:23442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1790773468.049241:0:23442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153472:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.049281:0:23442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773468.049309:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153472 00000100:00100000:1.0:1790773468.049313:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153472 00000100:00100000:1.0:1790773468.049329:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773468.049335:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153472:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.049428:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153472:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.049435:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773468.049458:0:23442:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773468.049472:0:23442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153472:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.049523:0:23442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23442:1877761496153600:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.049550:0:23442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773468.049570:0:23442:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b300 going to sleep for 11 seconds 00000004:00000080:3.0:1790773468.049994:0:23416:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790773468.050005:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1790773468.050070:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773468.052156:0:23441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790773468.052259:0:23441:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1790773468.053383:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153600 00000100:00100000:1.0:1790773468.053396:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153600 00000100:00100000:1.0:1790773468.053464:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773468.053474:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23442:x1877761496153600:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.053577:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23442:x1877761496153600:12345-0@lo:900:lod0001_rec0000.0 Request processed in 105us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.053585:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1790773468.054511:0:23416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:1.0:1790773468.056190:0:23442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d280f6ea00 x1877761496153600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773484 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773468.056235:0:23442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23442:1877761496153600:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.056373:0:23442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153728:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.056450:0:23442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773468.056503:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153728 00000100:00100000:1.0:1790773468.056512:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153728 00000040:00080000:3.0:1790773468.057024:0:23416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790773468.057100:0:23416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1790773468.057334:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790773468.057862:0:23416:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1790773468.058174:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773468.058190:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153728:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1790773468.058319:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23442:x1877761496153728:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 133us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773468.058327:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773468.058357:0:23442:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790773468.058392:0:23442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23442:1877761496153728:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1790773468.058446:0:23442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773468.063167:0:23442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790773468.063283:0:23442:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790773468.063288:0:23442:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1790773468.065505:0:23416:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790773468.070989:0:23416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790773468.071036:0:23416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb21f05573988 00100000:10000000:3.0:1790773468.071045:0:23416:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1790773468.075353:0:23416:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790773468.075389:0:23416:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790773468.075409:0:23416:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790773468.075436:0:23416:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1790773468.094410:0:23416:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773468.094601:0:23416:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790773468.495679:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:2.0:1790773469.010485:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773469.072356:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790773469.517330:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 10000000:01000000:1.0:1790773469.656741:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773469.656749:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14482b000 from 12 10000000:01000000:1.0:1790773469.656755:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773469.656803:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.656814:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.656826:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773469.656852:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496153856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773469.656918:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773469.656964:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773469.657065:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153856 00000100:00100000:2.0:1790773469.657083:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153856 00000100:00100000:2.0:1790773469.657134:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773469.657143:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:22680:x1877761496153856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773469.657167:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773469.657184:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78434b7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773469.657223:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773469.657234:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773469.657243:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526a00, rc 0) 00000100:00100000:2.0:1790773469.657289:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496153856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773469.657295:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790773469.657407:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496153856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773469.657422:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.657430:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773469.657483:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496153984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790773469.657514:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773469.657540:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26be9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773469.657645:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496153984 00000100:00100000:2.0:1790773469.657651:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496153984 00000100:00100000:2.0:1790773469.657715:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790773469.657723:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496153984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773469.657738:0:22678:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773469.657754:0:22678:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773469.657757:0:22678:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1790773469.657830:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496153984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773469.657837:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790773469.659663:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496153984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790773469.659729:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773469.659741:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773469.659750:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773469.659760:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773469.659763:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d24f7ba800 from 12 10000000:01000000:0.0:1790773469.659766:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773469.659792:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773469.659799:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773469.659807:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773469.659826:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496154112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773469.659871:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773469.663195:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773469.666603:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154112 00000100:00100000:1.0:1790773469.666618:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154112 00000100:00100000:1.0:1790773469.666680:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790773469.666690:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496154112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773469.666706:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773469.666722:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78434c5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.666750:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 18 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.666761:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 18 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773469.666770:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773469.666851:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496154112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (6980us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773469.666858:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790773469.669911:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496154112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773469.669942:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773469.669966:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773469.670040:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496154240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790773469.670112:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773469.670147:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773469.670760:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154240 00000100:00100000:2.0:1790773469.670769:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154240 00000100:00100000:2.0:1790773469.670816:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773469.670825:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496154240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773469.670857:0:22678:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773469.670873:0:22678:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773469.670876:0:22678:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1790773469.670983:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496154240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773469.670991:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790773469.671805:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496154240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790773469.671863:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773469.671872:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773469.671882:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773470.035950:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773470.110147:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773470.542392:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:2.0:1790773471.054539:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773471.565256:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00010000:00010000:3.0:1790773472.079074:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773472.589291:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 0 seconds 00000001:02000400:1.0:1790773472.908767:0:23685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790773473.102675:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773473.102699:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496154368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773473.102944:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790773473.103026:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790773473.103030:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790773473.103044:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773473.103049:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:3.0:1790773473.103054:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790773473.103063:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff93d25233a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773473.103082:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dc700 x1877761496154624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773473.103096:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773473.103099:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773473.103102:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773473.103105:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773473.103114:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773473.103123:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773473.103125:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773473.103128:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773473.103172:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496154496:0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.103225:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773473.103252:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773473.103257:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496154752:0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.103464:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773473.103501:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154496 00000100:00100000:3.0:1790773473.103508:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154496 00000100:00100000:3.0:1790773473.103547:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790773473.103554:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3606:x1877761496154496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.103604:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3606:x1877761496154496:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773473.103611:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790773473.103641:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154752 00000100:00100000:3.0:1790773473.103645:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154752 00000100:00100000:3.0:1790773473.103668:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773473.103673:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496154752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.103704:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496154752:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773473.103710:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790773473.104071:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447dd880 x1877761496154752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773473.104085:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496154752:0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.104103:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496154496:0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.104127:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496154880:0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.104159:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773473.104191:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154880 00000100:00100000:3.0:1790773473.104194:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154880 00000100:00100000:3.0:1790773473.104236:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773473.104242:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496154880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773473.104561:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496154880:12345-0@lo:400:kworker.0 Request processed in 317us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773473.104568:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790773473.104598:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447dc000 x1877761496154880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773473.104607:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496154880:0@lo:400:kworker.0 00000100:00100000:1.0:1790773473.105479:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154368 00000100:00100000:1.0:1790773473.105487:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154368 00000100:00100000:1.0:1790773473.105523:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773473.105531:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496154368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773473.105569:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790773473.105621:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496154368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773473.105627:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773473.105740:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496154368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773473.105746:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496154624:0@lo:38:kworker.0 00000100:00100000:0.0:1790773473.105782:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790773473.105881:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773473.105915:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496154624 00000100:00100000:3.0:1790773473.105919:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496154624 00000100:00100000:3.0:1790773473.105947:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773473.105952:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3603:x1877761496154624:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790773473.106054:0:22689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:3.0:1790773473.106088:0:22689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc78434d3 00000004:00100000:3.0:1790773473.106102:0:22689:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1790773473.106109:0:22689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1790773473.114124:0:22689:0:(import.c:65:import_set_state_nolock()) ffff93d27fa2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773473.114255:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496154624:12345-0@lo:38:kworker.0 Request processed in 8299us (8470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773473.114266:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773473.114533:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773473.114543:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790773473.114553:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1790773473.114558:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790773473.114561:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d25233a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1790773473.114586:0:3603:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d37dd602): req@ffff93d280f6f100 x1877761496147072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773473.114620:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496154624:0@lo:38:kworker.0 00000100:00100000:2.0:1790773473.114811:0:22726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773473.114844:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773473.114917:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496147072 00000100:00100000:0.0:1790773473.114926:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496147072 00000100:00100000:1.0:1790773473.114934:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496155008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773473.114964:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773473.114976:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155008 00000100:00100000:0.0:1790773473.114981:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155008 00000100:00100000:0.0:1790773473.115001:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773473.115010:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22726:x1877761496147072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790773473.115096:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22726:x1877761496147072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773473.115506:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773473.116809:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773473.116823:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496155008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773473.116872:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773473.116949:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496155008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773473.116957:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790773473.117007:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496155008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773473.119263:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22726:1877761496147072:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1790773473.119311:0:22726:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790773473.119371:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22726:1877761496155136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790773473.119442:0:22726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773473.119484:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773473.119508:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155136 00000100:00100000:3.0:1790773473.119515:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155136 00000100:00100000:3.0:1790773473.119563:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773473.119572:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877761496155136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790773473.119716:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877761496155136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773473.119736:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773473.119919:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22726:1877761496155136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790773473.119991:0:22726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22726:1877761496155264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1790773473.120020:0:22726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773473.120055:0:22726:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c1449c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773473.120199:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155264 00000100:00100000:3.0:1790773473.120224:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155264 00000100:00100000:3.0:1790773473.120251:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773473.120258:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877761496155264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790773473.120309:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22726:x1877761496155264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773473.120315:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773473.120342:0:22726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22726:1877761496155264:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1790773473.120390:0:22726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790773473.122462:0:22726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790773473.122536:0:22726:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1790773473.122541:0:22726:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1790773474.090588:0:23737:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773474.090892:0:23737:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773474.131693:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790773474.574070:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1790773475.114988:0:23787:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773475.116755:0:23787:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773475.155003:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773476.173390:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773461/real 1790773461] req@ffff93d2447de680 x1877761496148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773476.173419:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d2447de680 x1877761496148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790773476.173439:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790773476.173464:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790773476.173468:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148096:0@lo:8:kworker.0 00000100:00080000:3.0:1790773476.173568:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773476.173578:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790773476.173581:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773476.173586:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 604 00000100:00080000:3.0:1790773476.173591:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1790773476.173601:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d143271800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773476.173621:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dea00 x1877761496155648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773476.173636:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773476.173639:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773476.173664:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773476.173667:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773476.173670:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773476.173673:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773476.173701:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496155520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.173757:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.173796:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773476.173802:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496155392:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.173828:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.173849:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496156032:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.173873:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.173897:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496155648:0@lo:8:kworker.0 00000400:00000100:3.0:1790773476.173918:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496155648 offset 0 length 520: 4 00000100:00100000:3.0:1790773476.173939:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496155776:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.173967:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.173983:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773476.173988:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496155904:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174017:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.174046:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155520 00000100:00100000:3.0:1790773476.174054:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155520 00000100:00100000:3.0:1790773476.174083:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155904 00000100:00100000:3.0:1790773476.174085:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155904 00000100:00100000:3.0:1790773476.174098:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773476.174106:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496155520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174155:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496155520:12345-0@lo:400:kworker.0 Request processed in 50us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.174161:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773476.174177:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773476.174182:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496155904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174233:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496155904:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.174239:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773476.174256:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155392 00000100:00100000:3.0:1790773476.174259:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155392 00000100:00100000:3.0:1790773476.174279:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790773476.174285:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3607:x1877761496155392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174310:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3607:x1877761496155392:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.174315:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790773476.174336:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156032 00000100:00100000:3.0:1790773476.174339:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156032 00000100:00100000:3.0:1790773476.174364:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496155776 00000100:00100000:3.0:1790773476.174367:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496155776 00000100:00100000:3.0:1790773476.174377:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773476.174382:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496156032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174408:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496156032:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.174414:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773476.174423:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773476.174428:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496155776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174448:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496155776:12345-0@lo:400:kworker.0 Request processed in 20us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.174454:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773476.174492:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496155904:0@lo:400:kworker.0 00010000:00080000:3.0:1790773476.174503:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447dce00 x1877761496155776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773476.174512:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496155776:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174535:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496155392:0@lo:400:kworker.0 00010000:00080000:3.0:1790773476.174544:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d2447dc000 x1877761496156032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773476.174551:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496156032:0@lo:400:kworker.0 00000100:00100000:3.0:1790773476.174558:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496155520:0@lo:400:kworker.0 00010000:00010000:3.0:1790773476.177524:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790773476.206820:0:23835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf18b9590 20000000:00000080:3.0:1790773476.206838:0:23835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d26b5c9000 uarg=0000000000000000 20000000:01000000:3.0:1790773476.206883:0:23835:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790773476.206890:0:23835:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790773476.206894:0:23835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790773476.207607:0:23836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1790773476.207737:0:23835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790773476.217513:0:23835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790773476.217546:0:23835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.217578:0:23835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.217586:0:23835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.217594:0:23835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.217638:0:23835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.217668:0:23835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773476.217683:0:23835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23835:1877761496156160:0@lo:104: 00000100:00100000:2.0:1790773476.217931:0:23835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773476.217991:0:23835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 17 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.218000:0:23835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 17 pid: 22677 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773476.218019:0:23835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23835:1877761496156288:0@lo:104: 00000100:00100000:2.0:1790773476.218054:0:23835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773476.218083:0:23835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14465a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773476.218990:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156160 00000100:00100000:3.0:1790773476.219000:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156160 00000100:00100000:3.0:1790773476.219046:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156288 00000100:00100000:3.0:1790773476.219050:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156288 00000100:00100000:3.0:1790773476.219066:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773476.219074:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:23835:x1877761496156160:12345-0@lo:104: 00010000:00010000:3.0:1790773476.219087:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219160:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790773476.219166:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:23835:x1877761496156160:12345-0@lo:104: Request processed in 93us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.219176:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773476.219195:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773476.219201:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:23835:x1877761496156288:12345-0@lo:104: 00010000:00010000:3.0:1790773476.219227:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219259:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790773476.219264:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:23835:x1877761496156288:12345-0@lo:104: Request processed in 64us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.219270:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790773476.219286:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773476.219291:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219313:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773476.219317:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219325:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773476.219332:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773476.219337:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773476.219366:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219373:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773476.219391:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219397:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e5200/0xabf1cc0bc784347f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843486 expref: -99 pid: 23416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219409:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773476.219413:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219418:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d240031a00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:3.0:1790773476.219421:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219438:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790773476.219444:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773476.219449:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790773476.219460:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219466:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790773476.219479:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219486:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d240031a00/0xabf1cc0bc784337c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843383 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219500:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773476.219502:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773476.219503:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773476.219509:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773476.219519:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496156416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773476.219547:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.219581:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496156544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773476.219602:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773476.219627:0:22669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156416 00000100:00100000:3.0:1790773476.219631:0:22669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156416 00010000:00010000:3.0:1790773476.219648:0:22669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 18 pid: 22678 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773476.219673:0:22669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156544 00000100:00100000:3.0:1790773476.219676:0:22669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156544 00010000:00010000:3.0:1790773476.219687:0:22669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 19 pid: 22677 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773476.219703:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773476.219709:0:22669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:3607:x1877761496156416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773476.219719:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773476.219724:0:22669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 19 pid: 22678 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219733:0:22669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 19 pid: 22678 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219748:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773476.219774:0:22669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:3607:x1877761496156416:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.219780:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773476.219792:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773476.219797:0:22669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3604:x1877761496156544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773476.219805:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773476.219809:0:22669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 18 pid: 22677 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219818:0:22669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 18 pid: 22677 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219830:0:22669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219844:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219857:0:22669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219863:0:22669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219870:0:22669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219876:0:22669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219882:0:22669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773476.219886:0:22669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219894:0:22669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219903:0:22669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773476.219912:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773476.219944:0:22669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3604:x1877761496156544:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773476.219951:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773476.219993:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496156544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790773476.220036:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496156416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773476.220158:0:23835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d2532e4a00/0xabf1cc0bc7843486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784347f expref: 17 pid: 22678 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773476.220173:0:23835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23835:1877761496156160:0@lo:104: 00010000:00010000:2.0:1790773476.220184:0:23835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12a800/0xabf1cc0bc7843383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784337c expref: 16 pid: 22677 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773476.220193:0:23835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23835:1877761496156288:0@lo:104: 00010000:00010000:2.0:1790773476.220225:0:23835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.220235:0:23835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.220253:0:23835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773476.220259:0:23835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241527c00/0xabf1cc0bc78434da lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773477.197645:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773477.198660:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773467/real 1790773467] req@ffff93d143e00000 x1877761496150656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.198692:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143e00000 x1877761496150656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.198701:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773467/real 1790773467] req@ffff93d143e00700 x1877761496150528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.198712:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143e00700 x1877761496150528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.198721:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773462/real 1790773462] req@ffff93d1444c5180 x1877761496148608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.198730:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d1444c5180 x1877761496148608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773477 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790773477.198749:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773477.198771:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773477.198775:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150656:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790773477.198781:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773477.198785:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773477.198788:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496150528:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790773477.198791:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773477.198794:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773477.198814:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496148608:0@lo:8:kworker.0 00000100:00080000:0.0:1790773477.198953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773477.198957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790773477.198966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773477.198969:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790773477.198971:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773477.198977:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 605 00000100:00080000:0.0:1790773477.198981:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790773477.198992:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773477.199024:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e01880 x1877761496156800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773477.199055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773477.199058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790773477.199060:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773477.199063:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 610 00000100:00080000:0.0:1790773477.199065:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773477.199070:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d143c86800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773477.199081:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e01500 x1877761496157184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790773477.199088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790773477.199091:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790773477.199092:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790773477.199095:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 610 00000100:00080000:0.0:1790773477.199097:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790773477.199101:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1790773477.199111:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d143e01c00 x1877761496157312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773477.199193:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496156672:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199285:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773477.199320:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773477.199327:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496157440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199366:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773477.199395:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496156800:0@lo:8:kworker.0 00000400:00000100:3.0:1790773477.199419:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496156800 offset 0 length 520: 4 00000100:00100000:3.0:1790773477.199442:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496157184:0@lo:8:kworker.0 00000400:00000100:3.0:1790773477.199457:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496157184 offset 0 length 520: 4 00000100:00100000:3.0:1790773477.199467:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496157312:0@lo:8:kworker.0 00000400:00000100:3.0:1790773477.199486:0:3603:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877761496157312 offset 0 length 520: 4 00000100:00100000:3.0:1790773477.199507:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496157056:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199529:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773477.199545:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773477.199551:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496156928:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199572:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773477.199598:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157440 00000100:00100000:3.0:1790773477.199605:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157440 00000100:00100000:3.0:1790773477.199644:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156928 00000100:00100000:3.0:1790773477.199647:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156928 00000100:00100000:3.0:1790773477.199663:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773477.199670:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496157440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199720:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496157440:12345-0@lo:400:kworker.0 Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.199738:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790773477.199753:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773477.199759:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496156928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199790:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496156928:12345-0@lo:400:kworker.0 Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.199795:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773477.199811:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496156672 00000100:00100000:3.0:1790773477.199815:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496156672 00000100:00100000:3.0:1790773477.199831:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157056 00000100:00100000:3.0:1790773477.199833:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157056 00000100:00100000:3.0:1790773477.199844:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773477.199850:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199883:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3605:x1877761496156672:12345-0@lo:400:kworker.0 Request processed in 32us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.199889:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773477.199900:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773477.199905:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496157056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199931:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496157056:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.199936:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790773477.199968:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143e02680 x1877761496157440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.199979:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496157440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.199990:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496156672:0@lo:400:kworker.0 00010000:00080000:3.0:1790773477.200028:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d143e02d80 x1877761496156928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773477.200042:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496156928:0@lo:400:kworker.0 00000100:00100000:3.0:1790773477.200052:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496157056:0@lo:400:kworker.0 10000000:01000000:0.0:1790773477.773280:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773477.773288:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14482b000 from 13 10000000:01000000:0.0:1790773477.773294:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773477.773335:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.773347:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.773359:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773477.773382:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773477.773442:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773477.773489:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773477.773927:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157568 00000100:00100000:3.0:1790773477.773935:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157568 00000100:00100000:3.0:1790773477.773981:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790773477.773999:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+16:22680:x1877761496157568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773477.774015:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773477.774034:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78434e1 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773477.774053:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773477.774064:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773477.774072:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3e00, rc 0) 00000100:00100000:3.0:1790773477.774122:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.774129:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790773477.774146:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773477.774161:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.774170:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773477.774258:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773477.774284:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773477.774310:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773477.774667:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157696 00000100:00100000:3.0:1790773477.774672:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157696 00000100:00100000:3.0:1790773477.775097:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790773477.775105:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773477.775252:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.775275:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773477.776380:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790773477.776442:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790773477.776506:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773477.778235:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250e4b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790773477.780172:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157824 00000100:00100000:3.0:1790773477.780187:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157824 00000100:00100000:3.0:1790773477.780335:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790773477.780345:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773477.780813:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 468us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.780885:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773477.780888:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790773477.782177:0:23899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790773477.784113:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790773477.784151:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773477.784162:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773477.784180:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773477.785259:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773477.785264:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d24f7ba800 from 13 10000000:01000000:0.0:1790773477.785269:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773477.785312:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.785324:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.785336:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773477.785361:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773477.785429:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773477.785526:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773477.785812:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496157952 00000100:00100000:1.0:1790773477.785830:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496157952 00000100:00100000:1.0:1790773477.785915:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790773477.785926:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+17:22680:x1877761496157952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773477.785939:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773477.785950:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78434ef expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773477.785972:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 18 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773477.785982:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 18 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773477.786001:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b600, rc 0) 00000100:00100000:1.0:1790773477.786044:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496157952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773477.786060:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790773477.786256:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496157952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773477.786271:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.786280:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773477.786339:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773477.786364:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773477.786391:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158080 00000100:00100000:0.0:1790773477.786391:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25000 going to sleep for 11 seconds 00000100:00100000:3.0:1790773477.786395:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158080 00000100:00100000:3.0:1790773477.786428:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790773477.786436:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496158080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773477.786555:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496158080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773477.786562:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790773477.786573:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496158080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773477.786774:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496158208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773477.786812:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773477.786889:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda900 going to sleep for 11 seconds 00000100:00100000:1.0:1790773477.786901:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158208 00000100:00100000:1.0:1790773477.786905:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158208 00000100:00100000:1.0:1790773477.786927:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773477.786933:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496158208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773477.787031:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:22680:x1877761496158208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773477.787038:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790773477.787136:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496158208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790773477.788198:0:23901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790773477.788321:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790773477.788343:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773477.788352:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773477.788364:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773478.222532:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773478.224094:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496158336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773478.224164:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773478.225239:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158336 00000100:00100000:0.0:1790773478.225250:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158336 00000100:00100000:0.0:1790773478.225306:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790773478.225316:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496158336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773478.225353:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773478.225417:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496158336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773478.225424:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773478.227262:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496158336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773478.233399:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496158464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773478.233471:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773478.234812:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158464 00000100:00100000:1.0:1790773478.234889:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158464 00000100:00100000:1.0:1790773478.234949:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790773478.234960:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496158464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773478.235008:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773478.235087:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496158464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773478.235095:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773478.235133:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496158464:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790773479.245396:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790773479.254068:0:23417:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790773480.272455:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773480.334849:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790773481.293647:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773482.322186:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773482.322565:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773482.322570:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773482.322573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773482.322576:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773482.322591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773482.322594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773482.322597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773482.322600:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773482.322625:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496158720:0@lo:400:kworker.0 00000100:00100000:0.0:1790773482.322625:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496158592:0@lo:400:kworker.0 00000100:00100000:1.0:1790773482.322719:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773482.323519:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496158848:0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.325985:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158720 00000100:00100000:3.0:1790773482.326012:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158720 00000100:00100000:3.0:1790773482.326074:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773482.326084:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496158720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.326171:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496158720:12345-0@lo:400:kworker.0 Request processed in 89us (3452us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773482.326178:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773482.326496:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496158720:0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.328120:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496158976:0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.328193:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773482.328279:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158976 00000100:00100000:3.0:1790773482.328287:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158976 00000100:00100000:3.0:1790773482.328319:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773482.328327:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496158976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.328375:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496158976:12345-0@lo:400:kworker.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773482.328382:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790773482.328415:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496158976:0@lo:400:kworker.0 00000100:00100000:0.0:1790773482.328522:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773482.328568:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496159104:0@lo:400:kworker.0 00000100:00100000:0.0:1790773482.328612:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773482.328779:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158592 00000100:00100000:3.0:1790773482.328784:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158592 00000100:00100000:3.0:1790773482.328820:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790773482.328826:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3607:x1877761496158592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.328864:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:3607:x1877761496158592:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773482.328870:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790773482.328896:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159104 00000100:00100000:3.0:1790773482.328899:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159104 00000100:00100000:3.0:1790773482.328937:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773482.328943:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.328985:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496159104:12345-0@lo:400:kworker.0 Request processed in 42us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773482.328990:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773482.329016:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496158592:0@lo:400:kworker.0 00010000:00080000:3.0:1790773482.329027:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d280f6d180 x1877761496159104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773482.329037:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496159104:0@lo:400:kworker.0 00000100:00100000:2.0:1790773482.331769:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773482.332317:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496158848 00000100:00100000:3.0:1790773482.332326:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496158848 00000100:00100000:3.0:1790773482.332375:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773482.332385:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496158848:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1790773482.332541:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d280f6ea00 x1877761496158848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773482.332626:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496158848:0@lo:400:kworker.0 00000100:00100000:3.0:1790773482.332841:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496158848:12345-0@lo:400:kworker.0 Request processed in 457us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773482.332850:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773483.341389:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496159232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773483.341457:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773483.341533:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159232 00000100:00100000:3.0:1790773483.341540:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159232 00000100:00100000:3.0:1790773483.341588:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773483.341597:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496159232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790773483.341645:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790773483.341690:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496159232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773483.341708:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790773483.341770:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496159232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790773483.342419:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773483.342539:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773483.342552:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496159360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773483.342610:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773483.342672:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159360 00000100:00100000:0.0:1790773483.342678:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159360 00000100:00100000:0.0:1790773483.342713:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773483.342721:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496159360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773483.342743:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773483.342784:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496159360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773483.342815:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790773483.342857:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496159360:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1790773483.726055:0:24183:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790773483.726060:0:24183:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790773483.726061:0:24183:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790773483.726169:0:24183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d26ec3d800 00000020:01000004:3.0:1790773483.726186:0:24183:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790773483.726201:0:24183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790773483.726232:0:24183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93d27b2c0000) 00000020:00000080:3.0:1790773483.726251:0:24183:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790773483.810121:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1790773483.819281:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1790773483.819910:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1790773483.820617:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1790773483.821139:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790773483.822451:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1790773483.823556:0:24183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1790773483.829561:0:24183:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1790773483.831140:0:24183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790773483.831155:0:24183:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790773483.831168:0:24183:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc7843504 00000020:01000004:0.0:1790773483.831176:0:24183:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1790773483.831198:0:24183:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790773483.831201:0:24183:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790773483.831240:0:24183:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790773483.831246:0:24183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790773483.831259:0:24183:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d279ea4d40) 00000020:00000080:0.0:1790773483.831271:0:24183:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1790773483.839114:0:24183:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790773483.839357:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790773483.839364:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790773483.842414:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790773483.842428:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790773483.852926:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790773483.852957:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790773483.859398:0:24183:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790773483.859609:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790773483.859616:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790773483.864120:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790773483.864133:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790773483.898180:0:24183:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790773483.899513:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790773483.899522:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790773483.902520:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790773483.902534:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790773483.905374:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790773483.905983:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790773483.910499:0:24183:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773483.911455:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790773483.911461:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790773483.913132:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790773483.913143:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790773483.988071:0:24183:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790773483.988988:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790773483.989006:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790773483.990798:0:24183:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790773483.990811:0:24183:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1790773483.991598:0:24183:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1790773483.991629:0:24183:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1790773483.991636:0:24183:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790773484.045061:0:24183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790773484.045146:0:24183:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790773484.045151:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790773484.045153:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790773484.045155:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773484.045156:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773484.045157:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773484.045158:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773484.045307:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773484.045309:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773484.045311:0:24183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790773484.045315:0:24183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790773484.045317:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790773484.045319:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790773484.045320:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790773484.045321:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790773484.045322:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790773484.045323:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790773484.045324:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790773484.045326:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790773484.045327:0:24183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790773484.056316:0:24183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790773484.056341:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159488:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790773484.056475:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.056518:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9840 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.057790:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159488 00000100:00100000:0.0:1790773484.057802:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159488 00000100:00100000:0.0:1790773484.057874:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790773484.057900:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:24183:x1877761496159488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773484.057964:0:22676:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790773484.057967:0:22676:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790773484.057971:0:22676:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790773484.059530:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:24183:x1877761496159488:12345-0@lo:253:mount.lustre.0 Request processed in 1626us (3048us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.059553:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790773484.059597:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159488:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790773484.059612:0:24183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790773484.059627:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790773484.059628:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790773484.059630:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790773484.059631:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790773484.059632:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790773484.059633:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790773484.059635:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790773484.059637:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790773484.059638:0:24183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790773484.059957:0:24183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d26ec3d800 from lustre-OST0000 10000000:01000000:3.0:1790773484.059993:0:24183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790773484.059997:0:24183:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790773484.060005:0:24183:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d26bfc19c0 local copy 00010000:00010000:3.0:1790773484.060015:0:24183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.060122:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773484.060163:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.060283:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.060346:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159616 00000100:00100000:0.0:1790773484.060367:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159616 00000100:00100000:0.0:1790773484.060450:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790773484.060976:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:24183:x1877761496159616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773484.061081:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:24183:x1877761496159616:12345-0@lo:501:mount.lustre.0 Request processed in 623us (917us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773484.061089:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790773484.061257:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159616:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790773484.061273:0:24183:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790773484.061296:0:24183:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790773484.061303:0:24183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.061313:0:24183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773484.061339:0:24183:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d26ec3d800 10000000:01000000:3.0:1790773484.061344:0:24183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790773484.061361:0:24183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790773484.061374:0:24183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790773484.061378:0:24183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790773484.061381:0:24183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790773484.061403:0:24183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.061412:0:24183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.061422:0:24183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.061436:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790773484.061615:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.061639:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279ed9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.062017:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159744 00000100:00100000:0.0:1790773484.062025:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159744 00000100:00100000:0.0:1790773484.062116:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790773484.062126:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+18:24183:x1877761496159744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773484.062137:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773484.062150:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e6e00/0xabf1cc0bc7843519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843512 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.062173:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e6e00/0xabf1cc0bc7843519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843512 expref: 19 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.062183:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e6e00/0xabf1cc0bc7843519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843512 expref: 19 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.062240:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6e00, rc 0) 00000100:00100000:0.0:1790773484.062289:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496159744:12345-0@lo:101:mount.lustre.0 Request processed in 164us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.062296:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790773484.062375:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773484.062389:0:24183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843519 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.062398:0:24183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843519 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773484.071717:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1790773484.075329:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773484.083489:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1790773484.084638:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1790773484.085028:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1790773484.085045:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1790773484.085060:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1790773484.085074:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1790773484.085086:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1790773484.085097:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1790773484.085108:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1790773484.085146:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1790773484.085159:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1790773484.085172:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1790773484.085405:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1790773484.085416:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1790773484.091033:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773484.091111:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.091151:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.091256:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496159872 00000100:00100000:0.0:1790773484.091263:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496159872 00000100:00100000:0.0:1790773484.091318:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790773484.091328:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496159872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773484.091560:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496159872:12345-0@lo:501:mount.lustre.0 Request processed in 233us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.091569:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790773484.091749:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496159872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773484.091799:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773484.091854:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.091882:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.091999:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160000 00000100:00100000:0.0:1790773484.092004:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160000 00000100:00100000:0.0:1790773484.092040:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790773484.092048:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773484.093065:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160000:12345-0@lo:503:mount.lustre.0 Request processed in 1014us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.093075:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790773484.093175:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790773484.096652:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790773484.096859:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773484.096954:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.097003:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.099600:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160128 00000100:00100000:0.0:1790773484.099617:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160128 00000100:00100000:0.0:1790773484.099687:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790773484.099697:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773484.101451:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160128:12345-0@lo:502:mount.lustre.0 Request processed in 1749us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.101472:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790773484.101647:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773484.101911:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790773484.101962:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1790773484.101976:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1790773484.101989:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1790773484.102000:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1790773484.102012:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1790773484.102023:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1790773484.102034:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1790773484.102045:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1790773484.102055:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1790773484.102066:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1790773484.102077:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1790773484.102111:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773484.102159:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.102200:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.102845:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160256 00000100:00100000:0.0:1790773484.102854:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160256 00000100:00100000:0.0:1790773484.102903:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790773484.102913:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773484.103052:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160256:12345-0@lo:502:mount.lustre.0 Request processed in 141us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.103060:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790773484.104668:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773484.104782:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1790773484.104810:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1790773484.118769:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790773484.118783:0:24200:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1790773484.118791:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.118793:0:24200:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790773484.118800:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790773484.118819:0:24200:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d281ba99c0) 00000020:00000080:0.0:1790773484.118846:0:24200:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790773484.118852:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790773484.118973:0:24200:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ec3d800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790773484.118984:0:24200:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790773484.118992:0:24200:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xabf1cc0bc7843527 00010000:00010000:0.0:1790773484.128975:0:24200:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1790773484.131453:0:24200:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1790773484.146261:0:24200:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1790773484.151453:0:24200:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790773484.151467:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773484.151473:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151476:0:24200:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790773484.151479:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790773484.151482:0:24200:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1790773484.151483:0:24200:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773484.151485:0:24200:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790773484.151486:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790773484.151489:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151505:0:24200:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790773484.151509:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773484.151513:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151514:0:24200:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790773484.151517:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790773484.151520:0:24200:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790773484.151522:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773484.151524:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151526:0:24200:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790773484.151528:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773484.151530:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151531:0:24200:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790773484.151534:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790773484.151568:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773484.151571:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773484.151573:0:24200:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790773484.151576:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1790773484.154349:0:24183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1790773484.154411:0:24183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790773484.154440:0:24183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843519 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.154454:0:24183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a2400/0xabf1cc0bc7843512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843519 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773484.154463:0:24183:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ec3d800 from 1 10000000:01000000:2.0:1790773484.154467:0:24183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790773484.154519:0:24183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.154528:0:24183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.154540:0:24183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.154570:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773484.154679:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.154724:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29c000 going to sleep for 11 seconds 00000100:00100000:1.0:1790773484.154957:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160384 00000100:00100000:1.0:1790773484.154967:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160384 00000100:00100000:1.0:1790773484.155022:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790773484.155032:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:24183:x1877761496160384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773484.155052:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773484.155068:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784352e expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773484.155105:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 20 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773484.155117:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 20 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773484.155127:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12be00, rc 0) 00000100:00100000:1.0:1790773484.155175:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160384:12345-0@lo:101:mount.lustre.0 Request processed in 144us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773484.155182:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790773484.155263:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773484.155280:0:24183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773484.155290:0:24183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773484.161451:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790773484.162027:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773484.162260:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790773484.162286:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790773484.167376:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790773484.167396:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790773484.167410:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790773484.167424:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790773484.167438:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790773484.167452:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790773484.167466:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790773484.167501:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790773484.167558:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790773484.167586:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790773484.167592:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790773484.167926:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773484.168008:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.168059:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.168451:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160512 00000100:00100000:3.0:1790773484.168469:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160512 00000100:00100000:3.0:1790773484.168522:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790773484.168531:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773484.168680:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160512:12345-0@lo:501:mount.lustre.0 Request processed in 150us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.168689:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790773484.170847:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773484.170912:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773484.171008:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.171050:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.172348:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160640 00000100:00100000:3.0:1790773484.172360:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160640 00000100:00100000:3.0:1790773484.172418:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790773484.172427:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773484.173011:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160640:12345-0@lo:503:mount.lustre.0 Request processed in 583us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.173020:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790773484.177336:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790773484.177911:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790773484.178013:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773484.178091:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.178136:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.178659:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160768 00000100:00100000:3.0:1790773484.178678:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160768 00000100:00100000:3.0:1790773484.178727:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790773484.178738:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773484.178885:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160768:12345-0@lo:502:mount.lustre.0 Request processed in 149us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.178894:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790773484.178915:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790773484.179136:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1790773484.179166:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1790773484.179198:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1790773484.179241:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1790773484.179257:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1790773484.179271:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1790773484.179282:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1790773484.179308:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1790773484.179320:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1790773484.179331:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1790773484.179344:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1790773484.179377:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773484.179424:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.179453:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.179578:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496160896 00000100:00100000:3.0:1790773484.179584:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496160896 00000100:00100000:3.0:1790773484.179622:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790773484.179630:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773484.179733:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496160896:12345-0@lo:502:mount.lustre.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.179741:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790773484.179796:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496160896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773484.179840:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790773484.179857:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790773484.180515:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773484.180526:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180528:0:24204:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790773484.180534:0:24204:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ec3d800 00000020:00000080:1.0:1790773484.180537:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773484.180620:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773484.180740:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180742:0:24204:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790773484.180746:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773484.180749:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180750:0:24204:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790773484.180754:0:24204:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d26ec3d800 00000020:00000080:1.0:1790773484.180756:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773484.180810:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773484.180813:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180815:0:24204:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790773484.180817:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773484.180820:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180821:0:24204:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790773484.180825:0:24204:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ec3d800 00000020:00000080:1.0:1790773484.180827:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773484.180863:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773484.180867:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180868:0:24204:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790773484.180871:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790773484.180873:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180874:0:24204:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790773484.180878:0:24204:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d26ec3d800 00000020:00000080:1.0:1790773484.180880:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790773484.180903:0:24204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790773484.180906:0:24204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790773484.180913:0:24204:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790773484.180915:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1790773484.192947:0:24183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790773484.193004:0:24183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790773484.193021:0:24183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.193036:0:24183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773484.193101:0:24183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790773484.193104:0:24183:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d26ec3d800 10000000:01000000:2.0:1790773484.193107:0:24183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d26ec3d800 10000000:01000000:2.0:1790773484.193111:0:24183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790773484.193118:0:24183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d26ec3d800 from 1 10000000:01000000:2.0:1790773484.193121:0:24183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790773484.193160:0:24183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.193176:0:24183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.193190:0:24183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.193233:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773484.193306:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.193345:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27b29c840 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.206621:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161024 00000100:00100000:3.0:1790773484.206670:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161024 00000100:00100000:3.0:1790773484.207033:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1790773484.207054:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:24183:x1877761496161024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790773484.207081:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773484.207108:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2000/0xabf1cc0bc7843543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784353c expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.207152:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2000/0xabf1cc0bc7843543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784353c expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.207173:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2000/0xabf1cc0bc7843543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784353c expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.207183:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2000, rc 0) 00000100:00100000:3.0:1790773484.207287:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161024:12345-0@lo:101:mount.lustre.0 Request processed in 237us (13981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.207295:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790773484.208353:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773484.208380:0:24183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843543 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.208392:0:24183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843543 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773484.229579:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790773484.230052:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773484.233970:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790773484.234036:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790773484.234051:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790773484.234064:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790773484.234078:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790773484.234091:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790773484.234105:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790773484.234120:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790773484.234133:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790773484.234146:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790773484.234159:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790773484.234191:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790773484.234240:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790773484.234268:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790773484.234882:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790773484.234909:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790773484.234923:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790773484.234948:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790773484.234963:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790773484.234975:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790773484.234988:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790773484.235001:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790773484.235014:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790773484.235029:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790773484.235043:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790773484.235059:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790773484.235072:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790773484.235097:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790773484.235110:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790773484.235121:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790773484.235132:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790773484.235143:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790773484.235153:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790773484.235164:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790773484.235177:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790773484.235188:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790773484.235198:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790773484.235232:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790773484.235245:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790773484.235256:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790773484.235267:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790773484.235278:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790773484.235441:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790773484.235474:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790773484.235490:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790773484.235503:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790773484.235522:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790773484.235533:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790773484.235994:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790773484.236016:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790773484.236031:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790773484.236036:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790773484.236141:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773484.236235:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773484.236280:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.236979:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161152 00000100:00100000:3.0:1790773484.236990:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161152 00000100:00100000:3.0:1790773484.237056:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790773484.237066:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773484.237256:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161152:12345-0@lo:501:mount.lustre.0 Request processed in 191us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.237264:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790773484.238356:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773484.238412:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773484.238496:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773484.238532:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.239394:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161280 00000100:00100000:3.0:1790773484.239405:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161280 00000100:00100000:3.0:1790773484.239458:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790773484.239469:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773484.239621:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161280:12345-0@lo:503:mount.lustre.0 Request processed in 154us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.239630:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790773484.239831:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161280:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773484.242515:0:24183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773484.242877:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773484.243131:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773484.243786:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773484.243842:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161408 00000100:00100000:2.0:1790773484.243850:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161408 00000100:00100000:2.0:1790773484.243909:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790773484.243919:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773484.244073:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161408:12345-0@lo:502:mount.lustre.0 Request processed in 155us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.244082:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790773484.244575:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790773484.247109:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790773484.247162:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1790773484.247190:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1790773484.247263:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1790773484.247296:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1790773484.247325:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1790773484.247348:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1790773484.247361:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1790773484.247375:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790773484.247388:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1790773484.247402:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1790773484.247417:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1790773484.247431:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1790773484.247445:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1790773484.247460:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1790773484.247476:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1790773484.247493:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1790773484.247509:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1790773484.247526:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1790773484.247553:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1790773484.247571:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1790773484.247585:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1790773484.247599:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1790773484.247613:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1790773484.247627:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1790773484.247642:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1790773484.247656:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1790773484.247686:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1790773484.247704:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1790773484.247721:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1790773484.247735:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1790773484.247748:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1790773484.247856:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1790773484.247876:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1790773484.247892:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1790773484.247909:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1790773484.247924:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1790773484.247963:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1790773484.247976:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1790773484.247989:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1790773484.248002:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1790773484.248016:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1790773484.248029:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1790773484.248044:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1790773484.248057:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1790773484.248070:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1790773484.248084:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1790773484.248097:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1790773484.248171:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773484.248277:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773484.248323:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243de7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.248497:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161536 00000100:00100000:3.0:1790773484.248505:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161536 00000100:00100000:3.0:1790773484.248571:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790773484.248580:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773484.248725:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161536:12345-0@lo:502:mount.lustre.0 Request processed in 146us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.248734:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790773484.248781:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773484.248978:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790773484.249004:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790773484.249029:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773484.249072:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773484.249102:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d246b25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773484.249145:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161664 00000100:00100000:3.0:1790773484.249150:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161664 00000100:00100000:3.0:1790773484.249194:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790773484.249201:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773484.249302:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496161664:12345-0@lo:502:mount.lustre.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.249309:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790773484.249359:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496161664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773484.249401:0:24183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1790773484.249409:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790773484.256014:0:24210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790773484.256039:0:24210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d2512d0000) 00000020:00000080:3.0:1790773484.256070:0:24210:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1790773484.256179:0:24210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ec3d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790773484.256183:0:24210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ec3d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790773484.256186:0:24210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ec3d800 3 00010000:00080000:3.0:1790773484.256245:0:24210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d14335d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773484.258411:0:24210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1790773484.263456:0:24210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790773484.263511:0:24210:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790773484.263524:0:24210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xabf1cc0bc7843551 00000100:00080000:1.0:1790773484.263535:0:24210:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790773484.263623:0:24210:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d14335d000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773484.263664:0:24210:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d280f6ed80 x1877761496161792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773484.263747:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496161792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773484.263890:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790773484.264244:0:24210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790773484.264353:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.264358:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.264360:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.264363:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.264391:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.264395:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.264398:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.264400:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773484.264491:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496162048:0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.264527:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.264566:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773484.264572:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496161920:0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.264618:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.264650:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496162304:0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.264674:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.264692:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790773484.264697:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496162176:0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.264717:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.264918:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161792 00000100:00100000:3.0:1790773484.264927:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161792 00000100:00100000:3.0:1790773484.264961:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162048 00000100:00100000:3.0:1790773484.264964:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162048 00000100:00100000:3.0:1790773484.264984:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162304 00000100:00100000:3.0:1790773484.264986:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162304 00000100:00100000:3.0:1790773484.265000:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773484.265009:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496162048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.265064:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496162048:12345-0@lo:400:kworker.0 Request processed in 55us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.265071:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790773484.265087:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773484.265093:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496162304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.265124:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496162304:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.265130:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790773484.265140:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773484.265144:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496161792:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790773484.265164:0:22683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:3.0:1790773484.265192:0:22683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xabf1cc0bc7843558 00000004:00100000:3.0:1790773484.265242:0:22683:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773484.265277:0:22683:0:(import.c:65:import_set_state_nolock()) ffff93d14335c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773484.269745:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496161920 00000100:00100000:2.0:1790773484.269775:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496161920 00000100:00100000:2.0:1790773484.269820:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162176 00000100:00100000:2.0:1790773484.269823:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162176 00000100:00100000:2.0:1790773484.269842:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773484.269869:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496161920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773484.269985:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496161920:12345-0@lo:400:kworker.0 Request processed in 118us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.269993:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790773484.270010:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773484.270017:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496162176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773484.270048:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496162176:12345-0@lo:400:kworker.0 Request processed in 32us (5329us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.270054:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790773484.276838:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496161920:0@lo:400:kworker.0 00010000:00080000:2.0:1790773484.276869:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d1444c7b80 x1877761496162048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773484.276880:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496162048:0@lo:400:kworker.0 00000100:00100000:3.0:1790773484.280121:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3603:x1877761496161792:12345-0@lo:38:llog_process_th.0 Request processed in 14964us (16221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.280136:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773484.280341:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496162176:0@lo:400:kworker.0 00010000:00080000:3.0:1790773484.280361:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d1444c4700 x1877761496162304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773484.280372:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496162304:0@lo:400:kworker.0 00010000:00080000:0.0:1790773484.280502:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d280f6ed80 x1877761496161792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773484.280512:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773484.280521:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790773484.280529:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773484.280534:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790773484.280537:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d14335d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773484.280613:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3603:1877761496161792:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1790773484.283857:0:24210:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790773484.283876:0:24210:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93d281bacd40) 00000020:00000080:0.0:1790773484.283903:0:24210:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1790773484.284029:0:24210:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d26ec3d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790773484.284033:0:24210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d26ec3d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790773484.284036:0:24210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d26ec3d800 3 00010000:00080000:0.0:1790773484.284063:0:24210:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d143fa2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1790773484.288665:0:24210:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1790773484.289003:0:24210:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1790773484.289056:0:24210:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790773484.289069:0:24210:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xabf1cc0bc7843566 00000100:00080000:2.0:1790773484.289081:0:24210:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790773484.289094:0:24210:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff93d143fa2800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773484.289133:0:24210:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c7b80 x1877761496162432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790773484.289237:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496162432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773484.289308:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773484.291030:0:24210:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1790773484.291086:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.291092:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.291102:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.291105:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.291109:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.291112:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773484.291114:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773484.291117:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790773484.291734:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162432 00000100:00100000:2.0:1790773484.291747:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162432 00000100:00100000:2.0:1790773484.291912:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773484.291921:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3603:x1877761496162432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790773484.292014:0:22683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1790773484.292057:0:22683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xabf1cc0bc784356d 00000004:00100000:2.0:1790773484.292077:0:22683:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790773484.292120:0:22683:0:(import.c:65:import_set_state_nolock()) ffff93d2580df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773484.307697:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3603:x1877761496162432:12345-0@lo:38:llog_process_th.0 Request processed in 15765us (18377us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.307713:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1790773484.312051:0:24210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00010000:00080000:0.0:1790773484.312682:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d1444c7b80 x1877761496162432/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773484.312696:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773484.312707:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1790773484.312716:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773484.312721:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790773484.312724:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143fa2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773484.312751:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3603:1877761496162432:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1790773484.316850:0:24183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1790773484.316913:0:24183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790773484.316954:0:24183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843543 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773484.316968:0:24183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527e00/0xabf1cc0bc784353c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843543 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790773484.317043:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790773484.317045:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773484.317047:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773484.317048:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773484.317050:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773484.317051:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773484.317053:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773484.317056:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773484.317057:0:24183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790773484.317061:0:24183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1790773484.317064:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790773484.317065:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773484.317066:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773484.317067:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773484.317068:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773484.317078:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773484.317079:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773484.317080:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773484.317081:0:24183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790773484.317115:0:24183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790773484.317138:0:24183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496162560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790773484.317242:0:24183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773484.317293:0:24183:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ef8c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773484.317842:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162560 00000100:00100000:0.0:1790773484.317854:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162560 00000100:00100000:0.0:1790773484.317908:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790773484.317918:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496162560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773484.317974:0:22676:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790773484.318000:0:22676:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790773484.328542:0:22676:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790773484.328565:0:22676:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790773484.328632:0:22699:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790773484.328637:0:22699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790773484.328659:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328678:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328686:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328694:0:22699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328752:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328777:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 21 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.328809:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496162688:0@lo:104: 00000100:00100000:3.0:1790773484.328881:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773484.328967:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.328975:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 21 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.328984:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496162816:0@lo:104: 00000100:00100000:3.0:1790773484.329011:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.329037:0:22699:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d1445c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773484.329064:0:22666:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790773484.329083:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162688 00000100:00100000:2.0:1790773484.329090:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162688 00000100:00100000:2.0:1790773484.329134:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162816 00000100:00100000:2.0:1790773484.329137:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162816 00000100:00100000:2.0:1790773484.329153:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773484.329161:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496162688:12345-0@lo:104: 00010000:00010000:2.0:1790773484.329182:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.329265:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790773484.329272:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496162688:12345-0@lo:104: Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.329280:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773484.329298:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496162688:0@lo:104: 00000100:00100000:2.0:1790773484.329310:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773484.329316:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496162816:12345-0@lo:104: 00010000:00010000:2.0:1790773484.329324:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329344:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773484.329351:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329358:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773484.329363:0:22672:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.329368:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1790773484.329372:0:22672:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.329373:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496162816:12345-0@lo:104: Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773484.329379:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:0.0:1790773484.329380:0:22672:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773484.329386:0:22672:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773484.329415:0:22672:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329421:0:22672:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773484.329442:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.329451:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773484.329470:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496162944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773484.329470:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d2532e5c00/0xabf1cc0bc78434c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434cc expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329483:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773484.329486:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329492:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:0.0:1790773484.329495:0:22672:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.329497:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790773484.329502:0:22672:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790773484.329509:0:22672:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773484.329514:0:22672:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790773484.329528:0:22672:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329534:0:22672:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790773484.329558:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329565:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12ae00/0xabf1cc0bc78434b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434be expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.329577:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773484.329584:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773484.329586:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773484.329593:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773484.329606:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773484.329615:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496163072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790773484.329646:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773484.329709:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496162816:0@lo:104: 00010000:00010000:3.0:1790773484.329726:0:22699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.329749:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496162944 00000100:00100000:3.0:1790773484.329753:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496162944 00010000:00010000:3.0:1790773484.329782:0:22720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 22 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.329804:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163072 00000100:00100000:3.0:1790773484.329807:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163072 00010000:00010000:3.0:1790773484.329818:0:22720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 23 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773484.329836:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790773484.329842:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:3607:x1877761496162944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790773484.329861:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773484.329866:0:22720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 23 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.329876:0:22720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 23 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.329889:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78434cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78434c5 expref: 23 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773484.329900:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773484.330007:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773484.330015:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251200850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:3606:x1877761496163072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773484.330023:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790773484.330027:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 22 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330036:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 22 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330046:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526a00/0xabf1cc0bc78434be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78434b7 expref: 22 pid: 22677 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330056:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.330065:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:24183:x1877761496162560:12345-0@lo:253:mount.lustre.0 Request processed in 12148us (12822us total) trans 0 rc 0/0 00010000:00010000:0.0:1790773484.330065:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773484.330074:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 20000000:01000000:0.0:1790773484.330079:0:22668:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003092635s 00010000:00010000:0.0:1790773484.330083:0:22668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330090:0:22668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330107:0:22668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330114:0:22668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330120:0:22668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773484.330124:0:22668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330131:0:22668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330150:0:22668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773484.330166:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790773484.330196:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251200850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:3606:x1877761496163072:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773484.330233:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773484.330276:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496163072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773484.330938:0:22699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.330949:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773484.330968:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3600/0xabf1cc0bc7843574 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773484.331324:0:24183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:24183:1877761496162560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790773484.331338:0:24183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790773484.331341:0:24183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773484.331343:0:24183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790773484.331344:0:24183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773484.331345:0:24183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773484.331347:0:24183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773484.331348:0:24183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773484.331350:0:24183:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773484.331352:0:24183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773484.331353:0:24183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790773484.331366:0:24183:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1790773484.337174:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:3607:x1877761496162944:12345-0@lo:103:ldlm_bl.0 Request processed in 7309us (7653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773484.337190:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773484.338284:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496162944:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1790773484.340435:0:24183:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1790773484.361067:0:24183:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790773484.361079:0:24183:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790773484.361125:0:24183:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790773484.361196:0:24183:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790773484.361270:0:24183:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790773484.361295:0:24183:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1790773484.363757:0:24183:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773484.364032:0:24183:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790773484.379637:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790773484.814055:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790773485.389462:0:24265:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773485.389690:0:24265:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790773485.390716:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790773486.286369:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773486.286377:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14482b000 from 13 10000000:01000000:0.0:1790773486.286382:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773486.286438:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773486.286450:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773486.286475:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773486.286501:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773486.286576:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773486.286624:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773486.290964:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163200 00000100:00100000:2.0:1790773486.290982:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163200 00000100:00100000:2.0:1790773486.291044:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773486.291055:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+19:22680:x1877761496163200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773486.291076:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773486.291099:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784357b expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.291128:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 20 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.291140:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 20 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.291152:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526000, rc 0) 00000100:00100000:2.0:1790773486.291264:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:22680:x1877761496163200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773486.291284:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790773486.291352:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773486.291373:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.291383:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773486.291451:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790773486.291492:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773486.291538:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773486.291553:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163328 00000100:00100000:2.0:1790773486.291557:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163328 00000100:00100000:2.0:1790773486.291581:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790773486.291587:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:22680:x1877761496163328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773486.291602:0:22676:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773486.291617:0:22676:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773486.291620:0:22676:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790773486.291834:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:22680:x1877761496163328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773486.291842:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790773486.291875:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790773486.291946:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773486.291954:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.291973:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773486.291983:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790773486.291986:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d24f7ba800 from 13 10000000:01000000:2.0:1790773486.291989:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790773486.292010:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292018:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292027:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773486.292041:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790773486.292069:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773486.292083:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773486.292096:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163456 00000100:00100000:2.0:1790773486.292099:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163456 00000100:00100000:2.0:1790773486.292121:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790773486.292127:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:22680:x1877761496163456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773486.292135:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773486.292144:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843589 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292160:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 21 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292181:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 21 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292188:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526c00, rc 0) 00000100:00100000:2.0:1790773486.292239:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496163456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773486.292246:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790773486.292275:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773486.292286:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.292294:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773486.292329:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790773486.292357:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773486.292375:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26ee14480 going to sleep for 11 seconds 00000100:00100000:2.0:1790773486.292386:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163584 00000100:00100000:2.0:1790773486.292390:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163584 00000100:00100000:2.0:1790773486.292409:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790773486.292414:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496163584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790773486.292423:0:22677:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790773486.292434:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790773486.292437:0:22677:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1790773486.292506:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496163584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773486.294760:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790773486.294839:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496163584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790773486.294926:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790773486.294937:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.294948:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773486.415403:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773487.448276:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773488.462523:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496163712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773488.462607:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773488.462666:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163712 00000100:00100000:3.0:1790773488.462674:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163712 00000100:00100000:3.0:1790773488.462722:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773488.462731:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496163712:12345-0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790773488.462864:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:3.0:1790773488.463201:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790773488.463275:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496163712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 545us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773488.463284:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790773488.463309:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496163840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773488.463336:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773488.463401:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496163712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773488.463443:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163840 00000100:00100000:3.0:1790773488.463448:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163840 00000100:00100000:3.0:1790773488.463466:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773488.463473:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496163840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773488.463491:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790773488.463525:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496163840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773488.463531:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790773488.463701:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496163840:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1790773489.485311:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790773489.485579:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773489.485584:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773489.485588:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773489.485591:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773489.485615:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773489.485618:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790773489.485621:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773489.485629:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790773489.485672:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496164096:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.485764:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.485809:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496164608:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.485843:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.485870:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790773489.485876:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496163968:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.485920:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.485942:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496164480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.485962:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.485987:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496164224:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486007:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.486023:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496164736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486044:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.486054:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790773489.486059:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496164352:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486078:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773489.486111:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164096 00000100:00100000:1.0:1790773489.486119:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164096 00000100:00100000:1.0:1790773489.486159:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164352 00000100:00100000:1.0:1790773489.486161:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164352 00000100:00100000:1.0:1790773489.486176:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773489.486184:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496164096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486257:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496164096:12345-0@lo:400:kworker.0 Request processed in 73us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486274:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790773489.486290:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773489.486296:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496164352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486325:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496164352:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486330:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790773489.486347:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164608 00000100:00100000:1.0:1790773489.486350:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164608 00000100:00100000:1.0:1790773489.486370:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164480 00000100:00100000:1.0:1790773489.486372:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164480 00000100:00100000:1.0:1790773489.486380:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164224 00000100:00100000:1.0:1790773489.486381:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164224 00000100:00100000:1.0:1790773489.486389:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164736 00000100:00100000:1.0:1790773489.486391:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164736 00000100:00100000:1.0:1790773489.486401:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773489.486406:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496164608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486430:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496164608:12345-0@lo:400:kworker.0 Request processed in 23us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486435:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790773489.486444:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773489.486449:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496164480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486467:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496164480:12345-0@lo:400:kworker.0 Request processed in 18us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486473:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790773489.486480:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790773489.486485:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496164224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486513:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496164224:12345-0@lo:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486519:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790773489.486528:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773489.486533:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496164736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486552:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496164736:12345-0@lo:400:kworker.0 Request processed in 19us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486557:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773489.486573:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496163968 00000100:00100000:1.0:1790773489.486575:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496163968 00000100:00100000:1.0:1790773489.486594:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790773489.486599:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3607:x1877761496163968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486621:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3607:x1877761496163968:12345-0@lo:400:kworker.0 Request processed in 22us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773489.486627:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1790773489.486672:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496164352:0@lo:400:kworker.0 00010000:00080000:1.0:1790773489.486684:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d280f6ea00 x1877761496164224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773489.486694:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496164224:0@lo:400:kworker.0 00010000:00080000:1.0:1790773489.486704:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d280f6ce00 x1877761496164736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773489.486711:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496164736:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486740:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496163968:0@lo:400:kworker.0 00010000:00080000:1.0:1790773489.486761:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d280f6f480 x1877761496164480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773489.486768:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496164480:0@lo:400:kworker.0 00000100:00100000:1.0:1790773489.486777:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496164096:0@lo:400:kworker.0 00010000:00080000:1.0:1790773489.486784:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d280f6e680 x1877761496164608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773489.486791:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496164608:0@lo:400:kworker.0 00000100:00080000:3.0:1790773489.486995:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790773489.487000:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790773490.509353:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773490.581327:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790773491.536824:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790773491.786075:0:24557:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790773492.493342:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773477/real 1790773477] req@ffff93d143e01500 x1877761496157184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773492.493389:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143e01500 x1877761496157184/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773492.493401:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773477/real 1790773477] req@ffff93d143e01c00 x1877761496157312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773492.493412:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143e01c00 x1877761496157312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790773492.493437:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773492.493460:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773492.493465:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496157184:0@lo:8:kworker.0 00000100:00080000:3.0:1790773492.493472:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773492.493477:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790773492.493480:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496157312:0@lo:8:kworker.0 00000100:00100000:1.0:1790773492.494063:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496164864:0@lo:400:kworker.0 00000100:00100000:1.0:1790773492.494134:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773492.494228:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164864 00000100:00100000:3.0:1790773492.494237:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164864 00000100:00100000:3.0:1790773492.494289:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790773492.494299:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3605:x1877761496164864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790773492.496564:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773492.496571:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790773492.496574:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773492.496577:0:15123:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790773492.500699:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3605:x1877761496164864:12345-0@lo:400:kworker.0 Request processed in 6390us (6553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773492.500717:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1790773492.511921:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773492.511934:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790773492.511939:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773492.511948:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 619 00000100:00080000:2.0:1790773492.511956:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773492.511974:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff93d143c86800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773492.512016:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c5880 x1877761496165376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790773492.512044:0:15123:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790773492.512064:0:15123:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790773492.512066:0:15123:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790773492.512071:0:15123:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 619 00000100:00080000:2.0:1790773492.512074:0:15123:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790773492.512079:0:15123:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1790773492.512094:0:15123:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1444c5f80 x1877761496165504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773492.512158:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496165248:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512248:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512293:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773492.512299:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496165632:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512328:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512357:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496164992:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512381:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512398:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496165760:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512425:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512443:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790773492.512449:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496165120:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512469:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512486:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496165888:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512509:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.512538:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165248 00000100:00100000:2.0:1790773492.512546:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165248 00000100:00100000:2.0:1790773492.512583:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496164992 00000100:00100000:2.0:1790773492.512586:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496164992 00000100:00100000:2.0:1790773492.512602:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773492.512618:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496165248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512675:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496165248:12345-0@lo:400:kworker.0 Request processed in 58us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.512682:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790773492.512699:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773492.512704:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512732:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496164992:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.512738:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790773492.512754:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165632 00000100:00100000:2.0:1790773492.512757:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165632 00000100:00100000:2.0:1790773492.512774:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165760 00000100:00100000:2.0:1790773492.512776:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165760 00000100:00100000:2.0:1790773492.512795:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165120 00000100:00100000:2.0:1790773492.512798:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165120 00000100:00100000:2.0:1790773492.512806:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165888 00000100:00100000:2.0:1790773492.512808:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165888 00000100:00100000:2.0:1790773492.512822:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773492.512827:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496165632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512869:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496165632:12345-0@lo:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.512874:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773492.512886:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773492.512892:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496165760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512916:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496165760:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.512921:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773492.512938:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773492.512943:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496165120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.512967:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496165120:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.512972:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790773492.512981:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790773492.512986:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496165888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.513007:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496165888:12345-0@lo:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773492.513012:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1790773492.513038:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773492.513042:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790773492.513067:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1444c5180 x1877761496165120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773492.513081:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496165120:0@lo:400:kworker.0 00010000:00080000:2.0:1790773492.513091:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1444c4700 x1877761496165888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773492.513098:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496165888:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.513106:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496164992:0@lo:400:kworker.0 00010000:00080000:2.0:1790773492.513114:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1444c7b80 x1877761496165760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773492.513121:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496165760:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.513149:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496165376:0@lo:8:kworker.0 00000100:00100000:2.0:1790773492.513190:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773492.513240:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496165504:0@lo:8:kworker.0 00000100:00100000:2.0:1790773492.513259:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790773492.513297:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1444c6a00 x1877761496165632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773492.513306:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496165632:0@lo:400:kworker.0 00000100:00100000:2.0:1790773492.513315:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496165248:0@lo:400:kworker.0 00000100:00100000:1.0:1790773492.513472:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496164864:0@lo:400:kworker.0 00000100:00100000:0.0:1790773492.515039:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165376 00000100:00100000:0.0:1790773492.515052:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165376 00000100:00100000:0.0:1790773492.515087:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496165504 00000100:00100000:0.0:1790773492.515090:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496165504 00000100:00100000:0.0:1790773492.515102:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773492.515109:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496165376:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790773492.515137:0:24189:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:0.0:1790773492.515162:0:24189:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc7843597 00002000:00100000:0.0:1790773492.515176:0:24189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff93d143fa1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1790773492.515181:0:24189:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1790773492.515183:0:24189:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790773492.515350:0:24189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1790773492.515372:0:24189:0:(import.c:65:import_set_state_nolock()) ffff93d143fa7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773492.515444:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496165376:12345-0@lo:8:kworker.0 Request processed in 334us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773492.515460:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790773492.515478:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773492.515482:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496165504:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790773492.515494:0:24189:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1790773492.518072:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1444c5880 x1877761496165376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773492.518087:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790773492.518098:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790773492.518107:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790773492.518114:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790773492.518117:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143c86800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790773492.518134:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790773492.518141:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496165376:0@lo:8:kworker.0 00000004:00080000:1.0:1790773492.518717:0:23426:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1790773492.518745:0:23426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166144:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1790773492.518828:0:23426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773492.518874:0:23426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773492.518964:0:24188:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790773492.518972:0:24188:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790773492.518991:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790773492.519005:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496166016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773492.519032:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773492.519070:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166016 00000100:00100000:1.0:1790773492.519076:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166016 00000100:00100000:1.0:1790773492.519143:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790773492.519151:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3605:x1877761496166016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790773492.519179:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790773492.519252:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3605:x1877761496166016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773492.519260:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790773492.519285:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790773492.519315:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cf100 x1877761496166016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773492.519333:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496166016:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1790773492.520318:0:23425:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790773492.520454:0:23425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 635322248630ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790773492.520465:0:23425:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1790773492.528089:0:23417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1790773492.541014:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166144 00000100:00100000:1.0:1790773492.541028:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166144 00000100:00100000:3.0:1790773492.541236:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790773492.541250:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23426:x1877761496166144:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1790773492.545997:0:24585:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1790773492.546009:0:24585:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1790773492.546953:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23426:x1877761496166144:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5699us (28117us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773492.546966:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790773492.549725:0:23426:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cdc00 x1877761496166144/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773508 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773492.549744:0:23426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166144:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1790773492.549760:0:23426:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790773492.549807:0:23426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166272:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790773492.549878:0:23426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773492.550684:0:23426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773492.550841:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166272 00000100:00100000:3.0:1790773492.550849:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166272 00000100:00100000:3.0:1790773492.550976:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773492.550987:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23426:x1877761496166272:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1790773492.551019:0:24188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1790773492.551070:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23426:x1877761496166272:12345-0@lo:5:osp-pre-0-1.0 Request processed in 86us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773492.551077:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790773492.551390:0:23426:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cdc00 x1877761496166272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773508 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773492.551404:0:23426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166272:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790773492.551416:0:23426:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1790773492.551450:0:23426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166400:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790773492.551494:0:23426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773492.551522:0:23426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773492.554273:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496165504:12345-0@lo:8:kworker.0 Request processed in 38774us (40998us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773492.554291:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773492.554336:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166400 00000100:00100000:0.0:1790773492.554346:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166400 00000100:00080000:2.0:1790773492.555537:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773492.555547:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790773492.555552:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496165504:0@lo:8:kworker.0 00000100:00100000:0.0:1790773492.559080:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790773492.559108:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23426:x1877761496166400:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1790773492.559197:0:24188:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:2.0:1790773492.571247:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790773492.599161:0:24184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1790773492.599181:0:24184:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1790773492.599540:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23426:x1877761496166400:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40438us (48038us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790773492.599563:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790773492.601811:0:23426:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cdc00 x1877761496166400/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773508 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773492.601827:0:23426:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1790773492.601835:0:23426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23426:1877761496166400:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1790773492.601862:0:23426:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1790773492.601984:0:23426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23426:1877761496166528:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1790773492.602037:0:23426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773492.602074:0:23426:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773492.602115:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166528 00000100:00100000:0.0:1790773492.602124:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166528 00000100:00100000:0.0:1790773492.602177:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790773492.602187:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23426:x1877761496166528:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1790773492.602273:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23426:x1877761496166528:12345-0@lo:900:osp-pre-0-1.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773492.602281:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790773492.602829:0:23426:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2526cdc00 x1877761496166528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773508 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773492.602842:0:23426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23426:1877761496166528:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1790773492.891899:0:24610:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773492.892309:0:24610:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790773493.581676:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496166656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773493.581753:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773493.581835:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166656 00000100:00100000:0.0:1790773493.581856:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166656 00000100:00100000:0.0:1790773493.581907:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773493.581918:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496166656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773493.581956:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773493.582017:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496166656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773493.582025:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1790773493.582097:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773493.582174:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496166656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773493.592258:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496166784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773493.592335:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773493.592633:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166784 00000100:00100000:0.0:1790773493.592643:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166784 00000100:00100000:0.0:1790773493.592691:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773493.592701:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496166784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790773493.592734:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773493.601766:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496166784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9055us (9418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773493.601783:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790773493.606689:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496166784:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1790773494.033920:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1790773494.043787:0:24660:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790773494.044015:0:24660:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773494.612462:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773495.629571:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773496.589501:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773476/real 1790773476] req@ffff93d2447dea00 x1877761496155648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773496.589544:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d2447dea00 x1877761496155648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790773496.589565:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773496.589586:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790773496.589591:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496155648:0@lo:8:kworker.0 00000100:00080000:3.0:1790773496.589772:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773496.589776:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790773496.589779:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773496.589807:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:3.0:1790773496.589940:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790773496.589952:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d143271800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773496.589975:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dea00 x1877761496167168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773496.589988:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773496.589992:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790773496.590011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773496.590014:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773496.590016:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773496.590020:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 635 00000100:00080000:3.0:1790773496.590023:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790773496.590028:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773496.590038:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2447dc380 x1877761496167680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790773496.590241:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496166912:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590313:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590362:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496167552:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590390:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590418:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790773496.590423:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496167424:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590447:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590466:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496168064:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590489:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590526:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496167040:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590550:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590564:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496167808:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590583:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590600:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790773496.590606:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496167296:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590625:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590640:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496167936:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590661:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.590695:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167552 00000100:00100000:2.0:1790773496.590702:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167552 00000100:00100000:2.0:1790773496.590764:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773496.590794:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496167552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590853:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496167552:12345-0@lo:400:kworker.0 Request processed in 70us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.590860:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790773496.590884:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167424 00000100:00100000:2.0:1790773496.590888:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167424 00000100:00100000:2.0:1790773496.590905:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167040 00000100:00100000:2.0:1790773496.590907:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167040 00000100:00100000:2.0:1790773496.590919:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773496.590925:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496167424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.590958:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496167424:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.590964:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790773496.590977:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790773496.590982:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496167040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591013:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496167040:12345-0@lo:400:kworker.0 Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.591019:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790773496.591036:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168064 00000100:00100000:2.0:1790773496.591040:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168064 00000100:00100000:2.0:1790773496.591059:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167808 00000100:00100000:2.0:1790773496.591061:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167808 00000100:00100000:2.0:1790773496.591070:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167296 00000100:00100000:2.0:1790773496.591073:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167296 00000100:00100000:2.0:1790773496.591082:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167936 00000100:00100000:2.0:1790773496.591084:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167936 00000100:00100000:2.0:1790773496.591097:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773496.591103:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496168064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591142:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496168064:12345-0@lo:400:kworker.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.591149:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773496.591160:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773496.591165:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496167808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591193:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496167808:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.591198:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773496.591231:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790773496.591237:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496167296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591265:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496167296:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.591270:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790773496.591280:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790773496.591285:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496167936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591309:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496167936:12345-0@lo:400:kworker.0 Request processed in 24us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.591313:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790773496.591334:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790773496.591338:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773496.591340:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790773496.591370:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2447ded80 x1877761496167296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773496.591383:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496167296:0@lo:400:kworker.0 00010000:00080000:2.0:1790773496.591394:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2447dc000 x1877761496167936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773496.591410:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496167936:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591421:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496167040:0@lo:400:kworker.0 00010000:00080000:2.0:1790773496.591430:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2447df100 x1877761496167808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773496.591438:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496167808:0@lo:400:kworker.0 00000100:00100000:2.0:1790773496.591473:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496167424:0@lo:400:kworker.0 00010000:00080000:2.0:1790773496.591484:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d27c3aa680 x1877761496168064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773496.591492:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496168064:0@lo:400:kworker.0 00010000:00080000:2.0:1790773496.591501:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2447ddf80 x1877761496167552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773496.591509:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496167552:0@lo:400:kworker.0 00000100:00100000:0.0:1790773496.591802:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496167168:0@lo:8:kworker.0 00000100:00100000:0.0:1790773496.591855:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773496.591891:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496167680:0@lo:8:kworker.0 00000100:00100000:0.0:1790773496.591916:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773496.591948:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167168 00000100:00100000:0.0:1790773496.591952:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167168 00000100:00100000:0.0:1790773496.591975:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496167680 00000100:00100000:0.0:1790773496.591978:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496167680 00000100:00100000:0.0:1790773496.591990:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773496.591995:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496167168:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790773496.592021:0:24188:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:0.0:1790773496.592049:0:24188:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc784359e 00002000:00100000:0.0:1790773496.592065:0:24188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d143fa0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1790773496.592069:0:24188:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1790773496.592072:0:24188:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1790773496.592147:0:24188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790773496.592170:0:24188:0:(import.c:65:import_set_state_nolock()) ffff93d143fa6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773496.592234:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496167168:12345-0@lo:8:kworker.0 Request processed in 236us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773496.592241:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773496.592258:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773496.592262:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496167680:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1790773496.592273:0:24188:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790773496.592298:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496167680:12345-0@lo:8:kworker.0 Request processed in 35us (381us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790773496.592305:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790773496.592338:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d2447dea00 x1877761496167168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773496.592356:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773496.592363:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790773496.592370:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790773496.592375:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790773496.592377:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143271800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790773496.592390:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790773496.592395:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496167168:0@lo:8:kworker.0 00000100:00080000:0.0:1790773496.592407:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773496.592412:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790773496.592414:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496167680:0@lo:8:kworker.0 00000004:00080000:0.0:1790773496.592435:0:22707:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790773496.592682:0:22707:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 639394298208ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790773496.592694:0:22707:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1790773496.593119:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496166912 00000100:00100000:3.0:1790773496.593127:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496166912 00000100:00100000:3.0:1790773496.593171:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790773496.593179:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3607:x1877761496166912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773496.593253:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3607:x1877761496166912:12345-0@lo:400:kworker.0 Request processed in 75us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773496.593260:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790773496.593297:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496166912:0@lo:400:kworker.0 00000004:00080000:2.0:1790773496.598062:0:22708:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1790773496.598091:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22708:1877761496168320:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790773496.598164:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.598197:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773496.598475:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790773496.598491:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496168192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773496.598536:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773496.598578:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168320 00000100:00100000:0.0:1790773496.598585:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168320 00000100:00100000:0.0:1790773496.598642:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773496.598652:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22708:x1877761496168320:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1790773496.598909:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773496.599298:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168192 00000100:00100000:2.0:1790773496.599306:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168192 00000100:00100000:2.0:1790773496.599336:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790773496.599343:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496168192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773496.599363:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773496.599426:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1877761496168192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773496.599434:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790773496.600755:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1445d9500 x1877761496168192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773496.600783:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496168192:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1790773496.603154:0:22663:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1790773496.603470:0:24188:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1790773496.603486:0:24188:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1790773496.603493:0:24188:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:0.0:1790773496.618483:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773496.618497:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622774:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=639s v=(0 0) 00010000:00010000:0.0:1790773496.622780:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773496.622788:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622825:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622838:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622847:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622873:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.622888:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.622894:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622902:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.622907:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622931:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622948:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622955:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac5e736/0xabf1cc0bc78435a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.622980:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.622982:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.622984:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773496.629736:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773496.629752:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629771:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=639s v=(0 0) 00010000:00010000:0.0:1790773496.629776:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773496.629783:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629799:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629809:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629874:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629897:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.629910:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.629915:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629923:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.629928:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629937:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629956:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629963:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d428aeca/0xabf1cc0bc78435ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.629978:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.629980:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.629982:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773496.632526:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773496.632549:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632567:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=639s v=(0 0) 00010000:00010000:0.0:1790773496.632572:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773496.632578:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632595:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632606:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632613:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632633:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.632647:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.632652:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632661:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.632665:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632675:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632699:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632708:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ddebd86/0xabf1cc0bc78435b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.632727:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.632729:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.632731:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773496.638222:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.638251:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.638269:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.638274:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.638280:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.638295:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.638306:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.638314:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.638336:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.638425:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.638435:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.638445:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.638451:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.638462:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.638482:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.638490:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb30bf7b/0xabf1cc0bc78435ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.638524:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.638527:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.638529:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773496.641473:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.641489:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.641506:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.641511:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.641517:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.641533:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.641557:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.641565:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.641594:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.642302:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.642310:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642319:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.642323:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642332:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642350:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642357:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240212df/0xabf1cc0bc78435c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642380:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.642381:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.642383:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773496.642532:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.642538:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.642547:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.642551:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.642556:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.642566:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.642573:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.642581:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.642614:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.642824:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.642829:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642846:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.642850:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642858:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642869:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642876:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082e7cc56/0xabf1cc0bc78435c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.642890:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.642892:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.642893:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773496.643129:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.643134:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.643142:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.643146:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.643150:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.643302:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.643313:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.643320:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.643369:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773496.655243:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.655258:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.655276:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.655280:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.655286:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.655320:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.655331:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.655339:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657296:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790773496.657313:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657327:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.657332:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657343:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657375:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657383:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc78435cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657412:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.657416:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657423:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.657426:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657434:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657443:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.657452:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.657453:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.657456:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.657516:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.659432:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790773496.659445:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc78435d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773496.664805:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.664826:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.664912:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.664917:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.664924:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.664939:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.664959:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.664966:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.666022:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.666034:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.666054:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.666060:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.666071:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.666092:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.666104:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.666106:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.666108:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.666599:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.666723:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790773496.666730:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc78435dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773496.667464:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.667473:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.667487:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.667491:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.667497:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.667521:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.667530:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.667549:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.667566:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.669456:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.669469:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.669480:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.669486:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.669496:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.669525:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.669548:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ae9e98/0xabf1cc0bc78435e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.669575:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.669577:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.669579:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773496.670429:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.670441:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.670455:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.670460:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.670467:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.670480:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.670488:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.670495:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.670525:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773496.671864:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.671879:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.671906:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.671910:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.671917:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.671931:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.671939:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.671946:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.672062:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790773496.674729:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.674742:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.674758:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.674762:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.674768:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.674783:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.674806:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.674823:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676732:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773496.676747:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676759:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.676763:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676774:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676798:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676806:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bc0d85c/0xabf1cc0bc78435eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676847:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773496.676852:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676859:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ae00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.676862:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676877:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676888:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676896:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f57677/0xabf1cc0bc78435f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676911:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.676914:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676921:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.676924:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676932:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676941:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.676949:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.676950:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.676957:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.677071:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.679676:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790773496.679691:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a5f5ad/0xabf1cc0bc78435f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790773496.682729:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.682755:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.682772:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.682776:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.682783:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.682796:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.682807:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.682843:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.687703:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773496.688446:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.688456:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688474:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.688478:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.688484:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688499:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688520:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688528:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688542:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790773496.688891:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.688897:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688912:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.688916:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.688920:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688928:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688936:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688943:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.688952:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1790773496.689258:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773496.689266:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689274:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12bc00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.689279:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689289:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689307:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689315:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ed604b/0xabf1cc0bc7843600 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689334:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773496.689338:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689345:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.689348:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689355:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689373:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689380:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd642b5/0xabf1cc0bc7843607 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689391:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.689394:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689401:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.689404:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689411:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689421:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689427:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc784360e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689439:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.689441:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.689447:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773496.689572:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.689579:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.689587:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.689589:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.689594:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.689603:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.689623:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.689631:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.689653:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773496.689786:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.689792:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689799:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.689802:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689817:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689830:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689838:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d352d4fd/0xabf1cc0bc7843615 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.689851:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.689853:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.689855:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773496.690077:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.690083:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690092:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.690096:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.690100:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690109:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690117:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690124:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690155:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773496.690347:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.690352:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690360:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.690364:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690382:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690393:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690400:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ad13755/0xabf1cc0bc784361c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690414:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.690416:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.690417:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773496.690623:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773496.690629:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690637:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1790773496.690640:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773496.690645:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690655:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690663:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690670:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.690688:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773496.690800:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.690805:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690822:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.690826:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690834:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690845:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690865:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edbcaa1a/0xabf1cc0bc7843623 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.690878:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.690880:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.690882:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.691059:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.691064:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773496.695300:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.695311:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695328:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.695332:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.695339:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695352:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695361:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695369:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695385:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773496.695396:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773496.695408:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695415:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773496.695419:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695427:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695443:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695449:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007dc942a/0xabf1cc0bc784362a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695465:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.695467:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.695469:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773496.695977:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.695983:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.695993:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.695996:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.696000:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696021:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696029:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696037:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696049:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790773496.696373:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.696379:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696388:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.696391:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.696395:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696403:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696410:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696427:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.696447:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790773496.696574:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773496.696581:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696589:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.696599:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696607:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696620:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696628:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea94366/0xabf1cc0bc7843631 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696644:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773496.696648:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696655:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.696658:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696666:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696676:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696682:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d8f8875/0xabf1cc0bc7843638 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.696701:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.696702:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.696704:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773496.697249:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.697256:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697267:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.697271:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.697275:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697284:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697293:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697300:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697315:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773496.697566:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773496.697572:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.697579:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.697582:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.697590:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.697601:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.697607:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc784363f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.697620:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.697622:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.697623:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773496.697722:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.697728:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697742:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.697745:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.697749:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697758:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697767:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697775:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.697795:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773496.698017:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773496.698022:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698040:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.698044:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698052:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698063:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698070:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbf8d4fd/0xabf1cc0bc7843646 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698085:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.698086:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.698088:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773496.698152:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.698158:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698166:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.698169:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.698173:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698182:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698201:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698264:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698307:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790773496.698643:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.698649:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698658:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.698661:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.698665:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698673:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698680:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.698687:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698792:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773496.698798:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698805:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.698809:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698834:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698853:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698860:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d276718/0xabf1cc0bc784364d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698875:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773496.698878:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698884:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.698888:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698895:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698904:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.698911:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.698913:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.698915:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.698972:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790773496.698977:0:24188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2ae6a0f/0xabf1cc0bc7843654 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773496.699339:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773496.699346:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.699354:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=639s v=(0 0) 00010000:00010000:2.0:1790773496.699357:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773496.699362:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.699372:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.699380:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.699387:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773496.699395:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773496.699661:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773496.699668:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.699676:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ec00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773496.699680:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.699688:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.699700:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.699708:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c2bb83/0xabf1cc0bc784365b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773496.699735:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.699737:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773496.699739:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773496.704901:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.704917:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.704937:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.704948:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.704955:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.704970:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.704981:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.704989:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.705017:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790773496.706514:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.706527:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706542:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.706546:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.706552:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706564:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706574:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706588:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706599:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790773496.706956:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.706962:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706971:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.706974:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.706978:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706989:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.706996:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707004:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707013:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1790773496.707292:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.707298:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707312:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.707315:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.707318:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707328:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707335:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707342:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.707351:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1790773496.708673:0:24188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773496.708683:0:24188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.708697:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=639s v=(0 0) 00010000:00010000:3.0:1790773496.708700:0:24188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773496.708704:0:24188:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.708715:0:24188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.708734:0:24188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.708742:0:24188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773496.708752:0:24188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:3.0:1790773496.709015:0:24188:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1790773496.709106:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22708:x1877761496168320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110452us (110938us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773496.709117:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1790773496.709242:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1790773496.709250:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709269:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.709274:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709283:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709299:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709306:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843662 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709322:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790773496.709326:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709332:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.709335:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709342:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709350:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709363:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843669 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709374:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790773496.709378:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709385:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.709388:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709396:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709406:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709412:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012431c86/0xabf1cc0bc7843670 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709423:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773496.709426:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709432:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.709441:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709450:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709461:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709468:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079624829/0xabf1cc0bc7843677 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709481:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773496.709483:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709490:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773496.709493:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709500:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709522:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709529:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784367e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773496.709549:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.709550:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773496.709552:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773496.711408:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773496.711468:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22708:1877761496168320:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790773496.711495:0:22708:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1790773496.711605:0:22708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22708:1877761496168448:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790773496.711664:0:22708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773496.713756:0:22708:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773496.714854:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168448 00000100:00100000:1.0:1790773496.714867:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168448 00000100:00100000:1.0:1790773496.714931:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773496.714941:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22708:x1877761496168448:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1790773496.714986:0:24190:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1790773496.725139:0:24184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1790773496.725191:0:24184:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790773496.726761:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22708:x1877761496168448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11814us (15089us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790773496.726776:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773496.726873:0:22708:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1790773496.726883:0:22708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22708:1877761496168448:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790773496.726899:0:22708:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1790773497.615486:0:3603:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790773477/real 1790773477] req@ffff93d143e01880 x1877761496156800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773497.615513:0:3603:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d143e01880 x1877761496156800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790773497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773497.615576:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790773497.615596:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790773497.615598:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496156800:0@lo:8:kworker.0 00000100:00080000:3.0:1790773497.615700:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773497.615704:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773497.615706:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773497.615709:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 619 00000100:00080000:3.0:1790773497.615713:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790773497.615721:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773497.615739:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d4000 x1877761496168960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773497.615767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773497.615771:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773497.615772:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773497.615793:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 639 00000100:00080000:3.0:1790773497.615796:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790773497.615801:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773497.615823:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d5180 x1877761496169472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773497.615863:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496168832:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.615919:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.615944:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496169600:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.615959:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.615973:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790773497.615976:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496169088:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.615988:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.615996:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496169728:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.616010:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.616030:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168832 00000100:00100000:3.0:1790773497.616036:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168832 00000100:00100000:3.0:1790773497.616070:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773497.616075:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496168832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.616108:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496168832:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773497.616113:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790773497.616128:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169600 00000100:00100000:3.0:1790773497.616130:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169600 00000100:00100000:3.0:1790773497.616142:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169088 00000100:00100000:3.0:1790773497.616143:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169088 00000100:00100000:3.0:1790773497.616151:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169728 00000100:00100000:3.0:1790773497.616160:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169728 00000100:00100000:3.0:1790773497.616175:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773497.616180:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496169600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.616235:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1877761496169600:12345-0@lo:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773497.616239:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790773497.616247:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790773497.616251:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496169088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.616267:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1877761496169088:12345-0@lo:400:kworker.0 Request processed in 17us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773497.616271:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790773497.616276:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790773497.616280:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496169728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.616292:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496169728:12345-0@lo:400:kworker.0 Request processed in 13us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773497.616295:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790773497.616311:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496168960:0@lo:8:kworker.0 00000100:00100000:3.0:1790773497.616325:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.616343:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496169472:0@lo:8:kworker.0 00000100:00100000:3.0:1790773497.616354:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773497.616369:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168960 00000100:00100000:3.0:1790773497.616372:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168960 00000100:00100000:3.0:1790773497.616382:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169472 00000100:00100000:3.0:1790773497.616383:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169472 00000100:00100000:3.0:1790773497.616389:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773497.616392:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496168960:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790773497.618709:0:24189:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790773497.618830:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496168960:12345-0@lo:8:kworker.0 Request processed in 2434us (2501us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773497.618842:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790773497.618876:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790773497.618884:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496169472:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790773497.618894:0:24189:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790773497.618919:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3603:x1877761496169472:12345-0@lo:8:kworker.0 Request processed in 35us (2563us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790773497.618924:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1790773497.618987:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d4380 x1877761496169088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773497.619002:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3606:1877761496169088:0@lo:400:kworker.0 00010000:00080000:3.0:1790773497.619016:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d6680 x1877761496169728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773497.619024:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496169728:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.619035:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496168832:0@lo:400:kworker.0 00010000:00080000:3.0:1790773497.619045:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d7b80 x1877761496169600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773497.619053:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3606:1877761496169600:0@lo:400:kworker.0 00000100:00080000:3.0:1790773497.619096:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773497.619101:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790773497.619118:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496168960:0@lo:8:kworker.0 00000100:00080000:3.0:1790773497.619129:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790773497.619132:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790773497.619135:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496169472:0@lo:8:kworker.0 00000100:00100000:2.0:1790773497.619270:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496168576:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619312:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.619347:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169216:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619370:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.619388:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496169856:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619424:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.619444:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790773497.619450:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496168704:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619470:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.619495:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169344:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619515:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.619663:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169216 00000100:00100000:2.0:1790773497.619670:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169216 00000100:00100000:2.0:1790773497.619696:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168704 00000100:00100000:2.0:1790773497.619699:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168704 00000100:00100000:2.0:1790773497.619712:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773497.619718:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619768:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169216:12345-0@lo:400:kworker.0 Request processed in 49us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773497.619775:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790773497.619800:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790773497.619816:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496168704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619844:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496168704:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773497.619849:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790773497.619868:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169856 00000100:00100000:2.0:1790773497.619872:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169856 00000100:00100000:2.0:1790773497.619896:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773497.619902:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619931:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496169856:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773497.619936:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790773497.619966:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496168704:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.619976:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169216:0@lo:400:kworker.0 00010000:00080000:2.0:1790773497.619986:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d6d80 x1877761496169856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773497.620003:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496169856:0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.620024:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169344 00000100:00100000:2.0:1790773497.620027:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169344 00000100:00100000:2.0:1790773497.620049:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773497.620056:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773497.620088:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169344:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773497.620093:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773497.620117:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169344:0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.620786:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496168576 00000100:00100000:3.0:1790773497.620793:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496168576 00000100:00100000:3.0:1790773497.620846:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790773497.620854:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3604:x1877761496168576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773497.621463:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:3604:x1877761496168576:12345-0@lo:400:kworker.0 Request processed in 607us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773497.621472:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790773497.634914:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27c3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496168576:0@lo:400:kworker.0 00010000:00010000:2.0:1790773497.677375:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773497.678716:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773497.678738:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773497.678816:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773497.678864:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496169984 00000100:00100000:2.0:1790773497.678872:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496169984 00000100:00100000:2.0:1790773497.678918:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773497.678928:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773497.678951:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773497.678994:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496169984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773497.679001:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790773497.679045:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496169984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773498.701410:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773498.701433:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496170112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773498.701657:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773498.701701:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496170240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773498.701725:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773498.701941:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170112 00000100:00100000:2.0:1790773498.701949:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170112 00000100:00100000:2.0:1790773498.701987:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170240 00000100:00100000:2.0:1790773498.702005:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170240 00000100:00100000:2.0:1790773498.702038:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773498.702047:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496170112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773498.702084:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790773498.702140:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496170112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773498.702147:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790773498.702164:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790773498.702170:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496170240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773498.702187:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773498.702244:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496170240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773498.702251:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790773498.702664:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496170112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773498.702678:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496170240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1790773498.710672:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773499.725390:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773500.751038:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790773500.813968:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1790773501.356556:0:25006:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790773501.356560:0:25006:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1790773501.356562:0:25006:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1790773501.356677:0:25006:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d281bb3000 00000020:01000004:0.0:1790773501.356696:0:25006:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790773501.356765:0:25006:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790773501.356789:0:25006:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d281bab380) 00000020:00000080:0.0:1790773501.356873:0:25006:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790773501.398402:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1790773501.399343:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1790773501.399537:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1790773501.399870:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1790773501.400025:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1790773501.400177:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1790773501.400503:0:25006:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1790773501.403323:0:25006:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790773501.403542:0:25006:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790773501.403557:0:25006:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790773501.403569:0:25006:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc784368c 00000020:01000004:1.0:1790773501.403575:0:25006:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1790773501.403606:0:25006:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790773501.403609:0:25006:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790773501.403617:0:25006:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790773501.403648:0:25006:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1790773501.403652:0:25006:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790773501.413978:0:25006:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790773501.414017:0:25006:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790773501.414022:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790773501.414024:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790773501.414025:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773501.414026:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773501.414027:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773501.414028:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773501.414030:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773501.414032:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773501.414033:0:25006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773501.414037:0:25006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790773501.414039:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790773501.414040:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790773501.414041:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773501.414042:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773501.414043:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773501.414044:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773501.414045:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773501.414046:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773501.414047:0:25006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790773501.414081:0:25006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790773501.414101:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790773501.414177:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.414313:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.414388:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170368 00000100:00100000:0.0:1790773501.414396:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170368 00000100:00100000:0.0:1790773501.414493:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790773501.414503:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:25006:x1877761496170368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790773501.414535:0:22676:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790773501.414539:0:22676:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790773501.414543:0:22676:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1790773501.414868:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:25006:x1877761496170368:12345-0@lo:253:mount.lustre.0 Request processed in 365us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.414875:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790773501.415020:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790773501.415030:0:25006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790773501.415033:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773501.415034:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790773501.415044:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773501.415045:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773501.415046:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773501.415047:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773501.415048:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773501.415049:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773501.415050:0:25006:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790773501.415067:0:25006:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d281bb3000 from lustre-OST0001 10000000:01000000:1.0:1790773501.415093:0:25006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790773501.415095:0:25006:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790773501.415103:0:25006:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d26bfc19c0 local copy 00010000:00010000:1.0:1790773501.415113:0:25006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.415187:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773501.415237:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.415311:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfd240 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.416541:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170496 00000100:00100000:0.0:1790773501.416552:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170496 00000100:00100000:0.0:1790773501.416682:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790773501.416692:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:25006:x1877761496170496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773501.416928:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:25006:x1877761496170496:12345-0@lo:501:mount.lustre.0 Request processed in 236us (1689us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773501.416945:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790773501.417026:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170496:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790773501.417045:0:25006:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790773501.417071:0:25006:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790773501.417079:0:25006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.417090:0:25006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d241527600/0xabf1cc0bc78432bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78432c6 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773501.417120:0:25006:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d281bb3000 10000000:01000000:2.0:1790773501.417125:0:25006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790773501.417130:0:25006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790773501.417138:0:25006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790773501.417143:0:25006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790773501.417146:0:25006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790773501.417170:0:25006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.417178:0:25006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.417187:0:25006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773501.417219:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790773501.417256:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.417405:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773501.417495:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170624 00000100:00100000:1.0:1790773501.417501:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170624 00000100:00100000:1.0:1790773501.417525:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790773501.417532:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:25006:x1877761496170624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773501.417541:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773501.417554:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc784369a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843693 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.417575:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc784369a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843693 expref: 22 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.417585:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12bc00/0xabf1cc0bc784369a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843693 expref: 22 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.417593:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12bc00, rc 0) 00000100:00100000:1.0:1790773501.417637:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496170624:12345-0@lo:101:mount.lustre.0 Request processed in 106us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.417643:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790773501.417764:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773501.417787:0:25006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784369a expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.417796:0:25006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc784369a expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773501.418704:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1790773501.419538:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773501.422316:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790773501.422374:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790773501.422387:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790773501.422399:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790773501.422410:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790773501.422421:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790773501.422439:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790773501.422451:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790773501.422705:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1790773501.422739:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1790773501.422747:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1790773501.422912:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773501.422975:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.423015:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773501.423068:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170752 00000100:00100000:3.0:1790773501.423075:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170752 00000100:00100000:3.0:1790773501.423123:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790773501.423131:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496170752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790773501.423282:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496170752:12345-0@lo:501:mount.lustre.0 Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.423301:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790773501.423484:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790773501.423514:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773501.423547:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.423571:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773501.423656:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496170880 00000100:00100000:3.0:1790773501.423660:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496170880 00000100:00100000:3.0:1790773501.423687:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790773501.423693:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496170880:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790773501.424370:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496170880:12345-0@lo:503:mount.lustre.0 Request processed in 675us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.424378:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790773501.424513:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496170880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790773501.424977:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790773501.425048:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773501.425095:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.425170:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773501.425657:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171008 00000100:00100000:1.0:1790773501.425665:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171008 00000100:00100000:2.0:1790773501.426055:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790773501.426065:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496171008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773501.426710:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496171008:12345-0@lo:502:mount.lustre.0 Request processed in 646us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.426719:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790773501.426899:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447ddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790773501.427163:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1790773501.427193:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1790773501.427296:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1790773501.427315:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1790773501.427330:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1790773501.427345:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1790773501.427358:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1790773501.427372:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1790773501.427382:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1790773501.427418:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773501.427545:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.427627:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773501.427684:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171136 00000100:00100000:2.0:1790773501.427691:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171136 00000100:00100000:2.0:1790773501.427734:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790773501.427742:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496171136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773501.427860:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496171136:12345-0@lo:502:mount.lustre.0 Request processed in 118us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.427867:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790773501.427988:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790773501.428026:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1790773501.428033:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1790773501.429526:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790773501.429536:0:25010:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1790773501.429544:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.429546:0:25010:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790773501.429552:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790773501.429567:0:25010:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d141d83380) 00000020:00000080:2.0:1790773501.429592:0:25010:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790773501.429599:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790773501.429664:0:25010:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d281bb3000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790773501.429673:0:25010:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790773501.429681:0:25010:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xabf1cc0bc78436a8 00010000:00010000:2.0:1790773501.433681:0:25010:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1790773501.434183:0:25010:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1790773501.436427:0:25010:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1790773501.437937:0:25010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790773501.437948:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773501.437955:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.437957:0:25010:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790773501.437960:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773501.437964:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.437966:0:25010:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790773501.437968:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790773501.437971:0:25010:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790773501.437972:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773501.437974:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.437976:0:25010:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790773501.437978:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790773501.437980:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.437988:0:25010:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790773501.437992:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790773501.438016:0:25010:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790773501.438019:0:25010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790773501.438020:0:25010:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790773501.438023:0:25010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1790773501.438228:0:25006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790773501.438255:0:25006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790773501.438271:0:25006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784369a expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.438283:0:25006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d24166ec00/0xabf1cc0bc7843693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc784369a expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773501.438301:0:25006:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d281bb3000 from 1 10000000:01000000:1.0:1790773501.438304:0:25006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773501.438339:0:25006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.438346:0:25006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.438357:0:25006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.438380:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790773501.438444:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.438489:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790773501.438741:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171264 00000100:00100000:2.0:1790773501.438749:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171264 00000100:00100000:2.0:1790773501.438798:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790773501.438817:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496171264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790773501.438830:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773501.438843:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78436af expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.438866:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.438877:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.438885:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166f400, rc 0) 00000100:00100000:2.0:1790773501.438933:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171264:12345-0@lo:101:mount.lustre.0 Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.438940:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790773501.439077:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790773501.439093:0:25006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.439103:0:25006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790773501.440178:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1790773501.440437:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790773501.440605:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1790773501.440626:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1790773501.440650:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1790773501.440663:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1790773501.440673:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1790773501.440693:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1790773501.440704:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1790773501.440715:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1790773501.440727:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1790773501.440738:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1790773501.440749:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1790773501.440763:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1790773501.440778:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1790773501.441161:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773501.441256:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.441293:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.441366:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171392 00000100:00100000:0.0:1790773501.441373:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171392 00000100:00100000:0.0:1790773501.441418:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790773501.441427:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773501.441545:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171392:12345-0@lo:501:mount.lustre.0 Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.441552:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790773501.441693:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790773501.441727:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790773501.441794:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.441916:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251cfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.443907:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171520 00000100:00100000:0.0:1790773501.443921:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171520 00000100:00100000:0.0:1790773501.444822:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790773501.444834:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773501.444997:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171520:12345-0@lo:503:mount.lustre.0 Request processed in 166us (3228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.445004:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790773501.445306:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790773501.445742:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790773501.445847:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773501.445891:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.445931:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773501.446093:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171648 00000100:00100000:1.0:1790773501.446100:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171648 00000100:00100000:1.0:1790773501.446141:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790773501.446148:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790773501.446257:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171648:12345-0@lo:502:mount.lustre.0 Request processed in 108us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.446264:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790773501.446375:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773501.446586:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1790773501.446612:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1790773501.446629:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1790773501.446643:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1790773501.446656:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1790773501.446669:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1790773501.446682:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1790773501.446709:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1790773501.446724:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1790773501.446738:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1790773501.446750:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1790773501.446780:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790773501.446950:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.447012:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.449303:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171776 00000100:00100000:0.0:1790773501.449315:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171776 00000100:00100000:0.0:1790773501.449372:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790773501.449381:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.449541:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171776:12345-0@lo:502:mount.lustre.0 Request processed in 161us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.449550:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790773501.449725:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790773501.449825:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1790773501.449839:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1790773501.452447:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773501.452474:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452477:0:25014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790773501.452484:0:25014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d281bb3000 00000020:00000080:0.0:1790773501.452495:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773501.452505:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773501.452508:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452509:0:25014:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790773501.452511:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773501.452513:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452514:0:25014:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790773501.452517:0:25014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d281bb3000 00000020:00000080:0.0:1790773501.452519:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773501.452669:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773501.452673:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452674:0:25014:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790773501.452676:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773501.452679:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452680:0:25014:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773501.452683:0:25014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d281bb3000 00000020:00000080:0.0:1790773501.452685:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773501.452702:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773501.452712:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452713:0:25014:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790773501.452716:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790773501.452718:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452720:0:25014:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1790773501.452723:0:25014:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d281bb3000 00000020:00000080:0.0:1790773501.452725:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790773501.452747:0:25014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790773501.452750:0:25014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790773501.452752:0:25014:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1790773501.452755:0:25014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1790773501.453086:0:25006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1790773501.453118:0:25006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773501.453142:0:25006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.453164:0:25006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773501.453232:0:25006:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790773501.453235:0:25006:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d281bb3000 10000000:01000000:0.0:1790773501.453238:0:25006:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d281bb3000 10000000:01000000:0.0:1790773501.453242:0:25006:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790773501.453248:0:25006:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d281bb3000 from 1 10000000:01000000:0.0:1790773501.453251:0:25006:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790773501.453287:0:25006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.453295:0:25006:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.453307:0:25006:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773501.453329:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790773501.453391:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.453427:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496171904 00000100:00100000:0.0:1790773501.453435:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496171904 00000100:00100000:0.0:1790773501.458005:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790773501.458026:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:25006:x1877761496171904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773501.458045:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773501.458064:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e7600/0xabf1cc0bc78436c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78436bd expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.458110:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e7600/0xabf1cc0bc78436c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78436bd expref: 24 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.458123:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e7600/0xabf1cc0bc78436c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78436bd expref: 24 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.458132:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7600, rc 0) 00000100:00100000:0.0:1790773501.458231:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496171904:12345-0@lo:101:mount.lustre.0 Request processed in 212us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.458238:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790773501.458310:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d243f8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.458343:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496171904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790773501.458362:0:25006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436c4 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.458371:0:25006:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78436c4 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773501.461912:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1790773501.462245:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790773501.462435:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1790773501.462528:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1790773501.462553:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1790773501.462568:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1790773501.462582:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1790773501.462595:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1790773501.462609:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1790773501.462638:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1790773501.462663:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1790773501.462676:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1790773501.462688:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1790773501.462700:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1790773501.462713:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1790773501.462725:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1790773501.462738:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1790773501.462751:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1790773501.462763:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1790773501.462792:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1790773501.462979:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1790773501.462999:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1790773501.463014:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1790773501.463029:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1790773501.463045:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1790773501.463076:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1790773501.463093:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1790773501.463108:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1790773501.463122:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1790773501.463137:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1790773501.463151:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1790773501.463165:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1790773501.463179:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1790773501.463193:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1790773501.463244:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1790773501.463262:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1790773501.463277:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1790773501.463289:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1790773501.463302:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1790773501.463315:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1790773501.463329:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1790773501.463355:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1790773501.463373:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1790773501.463398:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1790773501.463413:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1790773501.463427:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1790773501.463441:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1790773501.463452:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1790773501.464674:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1790773501.464704:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1790773501.465335:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1790773501.465361:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1790773501.465377:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1790773501.465382:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1790773501.466343:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773501.466419:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.466870:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172032 00000100:00100000:0.0:1790773501.466879:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172032 00000100:00100000:0.0:1790773501.466927:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790773501.466935:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773501.467052:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172032:12345-0@lo:501:mount.lustre.0 Request processed in 117us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.467058:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1790773501.467102:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d25315ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.467121:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790773501.467153:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790773501.467189:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.467709:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773501.474638:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172160 00000100:00100000:2.0:1790773501.474653:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172160 00000100:00100000:2.0:1790773501.474757:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790773501.474778:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790773501.474944:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172160:12345-0@lo:503:mount.lustre.0 Request processed in 178us (7753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.474961:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790773501.475100:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790773501.479353:0:25006:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790773501.479452:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.479537:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.479577:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172288 00000100:00100000:0.0:1790773501.479584:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172288 00000100:00100000:0.0:1790773501.479629:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790773501.479637:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.479733:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172288:12345-0@lo:502:mount.lustre.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.479740:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1790773501.479921:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.479945:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773501.480103:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1790773501.480129:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1790773501.480141:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1790773501.480154:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1790773501.480167:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1790773501.480179:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1790773501.480190:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1790773501.480221:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1790773501.480238:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1790773501.480264:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1790773501.480277:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1790773501.480289:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1790773501.480301:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1790773501.480312:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1790773501.480324:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1790773501.480335:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1790773501.480345:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1790773501.480355:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1790773501.480375:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1790773501.480386:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1790773501.480397:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1790773501.480407:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1790773501.480419:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1790773501.480431:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1790773501.480443:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1790773501.480635:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1790773501.480651:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1790773501.480663:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1790773501.480675:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1790773501.480687:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1790773501.480699:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1790773501.480712:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1790773501.480726:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1790773501.480739:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1790773501.480752:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1790773501.480775:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1790773501.480792:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1790773501.480878:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1790773501.480895:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1790773501.480907:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1790773501.480920:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1790773501.480945:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1790773501.480957:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1790773501.480967:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1790773501.480978:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1790773501.480988:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1790773501.481000:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1790773501.481011:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1790773501.481049:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.481103:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.481155:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172416 00000100:00100000:0.0:1790773501.481161:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172416 00000100:00100000:0.0:1790773501.481190:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773501.481198:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.481311:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172416:12345-0@lo:502:mount.lustre.0 Request processed in 113us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.481318:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790773501.481358:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773501.481379:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790773501.484188:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790773501.484665:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790773501.484716:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790773501.484808:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.484863:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d27c144c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790773501.485408:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172544 00000100:00100000:2.0:1790773501.485419:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172544 00000100:00100000:2.0:1790773501.485551:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790773501.485561:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790773501.485695:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496172544:12345-0@lo:502:mount.lustre.0 Request processed in 135us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.485703:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790773501.486812:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496172544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790773501.486914:0:25006:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1790773501.486928:0:25006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1790773501.493560:0:25018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790773501.493579:0:25018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93d141d80000) 00000020:00000080:2.0:1790773501.493606:0:25018:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1790773501.493684:0:25018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d281bb3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790773501.493688:0:25018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d281bb3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790773501.493690:0:25018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d281bb3000 3 00010000:00080000:2.0:1790773501.493723:0:25018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d1448aa000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773501.503659:0:25018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1790773501.503928:0:25018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1790773501.503976:0:25018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790773501.503988:0:25018:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xabf1cc0bc78436d2 00000100:00080000:3.0:1790773501.503998:0:25018:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773501.504008:0:25018:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d1448aa000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773501.504045:0:25018:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d5180 x1877761496172672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773501.504075:0:25018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790773501.504130:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773501.504134:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773501.504136:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773501.504139:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 640 00000100:00080000:3.0:1790773501.504142:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790773501.504147:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773501.504157:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d4380 x1877761496173056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773501.504180:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790773501.504184:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790773501.504186:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790773501.504195:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 640 00000100:00080000:3.0:1790773501.504197:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790773501.504226:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773501.504248:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d1437d6300 x1877761496173568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790773501.504289:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496172800:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504347:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504373:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496173440:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504392:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504409:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790773501.504413:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496173312:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504429:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504448:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496173952:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504481:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504501:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496173184:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504520:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504532:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496173824:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504547:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504562:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790773501.504566:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496172928:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504585:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504601:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496173696:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504635:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.504657:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173440 00000100:00100000:3.0:1790773501.504663:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173440 00000100:00100000:3.0:1790773501.504706:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172928 00000100:00100000:3.0:1790773501.504709:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172928 00000100:00100000:3.0:1790773501.504730:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773501.504738:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496173440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504798:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496173440:12345-0@lo:400:kworker.0 Request processed in 60us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.504804:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790773501.504819:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773501.504825:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496172928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504852:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496172928:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.504857:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790773501.504877:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173952 00000100:00100000:3.0:1790773501.504880:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173952 00000100:00100000:3.0:1790773501.504896:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173184 00000100:00100000:3.0:1790773501.504898:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173184 00000100:00100000:3.0:1790773501.504906:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173824 00000100:00100000:3.0:1790773501.504908:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173824 00000100:00100000:3.0:1790773501.504928:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173696 00000100:00100000:3.0:1790773501.504931:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173696 00000100:00100000:3.0:1790773501.504941:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773501.504946:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496173952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.504972:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1877761496173952:12345-0@lo:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.504977:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790773501.504987:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790773501.504991:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496173184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.505011:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496173184:12345-0@lo:400:kworker.0 Request processed in 19us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.505021:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790773501.505030:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773501.505035:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496173824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.505056:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496173824:12345-0@lo:400:kworker.0 Request processed in 21us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.505062:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790773501.505070:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790773501.505074:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496173696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.505094:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1877761496173696:12345-0@lo:400:kworker.0 Request processed in 19us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.505098:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790773501.505137:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496172928:0@lo:400:kworker.0 00010000:00080000:3.0:1790773501.505150:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d6d80 x1877761496173696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773501.505159:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3605:1877761496173696:0@lo:400:kworker.0 00010000:00080000:3.0:1790773501.505171:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d5f80 x1877761496173184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773501.505178:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496173184:0@lo:400:kworker.0 00010000:00080000:3.0:1790773501.505186:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d4700 x1877761496173824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773501.505194:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496173824:0@lo:400:kworker.0 00010000:00080000:3.0:1790773501.505243:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d144547800 x1877761496173952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773501.505257:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3607:1877761496173952:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.505267:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496173440:0@lo:400:kworker.0 00000100:00100000:1.0:1790773501.505374:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172800 00000100:00100000:1.0:1790773501.505379:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172800 00000100:00100000:1.0:1790773501.505403:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173312 00000100:00100000:1.0:1790773501.505406:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173312 00000100:00100000:1.0:1790773501.505417:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773501.505423:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496172800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773501.505466:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496172800:12345-0@lo:400:kworker.0 Request processed in 44us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.505472:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790773501.505484:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790773501.505490:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496173312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773501.505511:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496173312:12345-0@lo:400:kworker.0 Request processed in 22us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.505516:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790773501.506944:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496172672:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773501.507010:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.507050:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496173056:0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507072:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.507085:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496173568:0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507103:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773501.507133:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773501.507138:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773501.507141:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773501.507152:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173056 00000100:00100000:0.0:1790773501.507159:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173056 00000100:00100000:0.0:1790773501.507180:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496173568 00000100:00100000:0.0:1790773501.507182:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496173568 00000100:00100000:0.0:1790773501.507220:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773501.507226:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3603:x1877761496173056:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507281:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3603:x1877761496173056:12345-0@lo:8:kworker.0 Request processed in 54us (207us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790773501.507288:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773501.507304:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773501.507308:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3603:x1877761496173568:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507335:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3603:x1877761496173568:12345-0@lo:8:kworker.0 Request processed in 25us (231us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790773501.507340:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790773501.507367:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773501.507375:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773501.507379:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790773501.507382:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496173056:0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507391:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773501.507394:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790773501.507396:0:3603:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790773501.507398:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496173568:0@lo:8:kworker.0 00000100:00100000:0.0:1790773501.507420:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496172672 00000100:00100000:0.0:1790773501.507423:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496172672 00000100:00100000:0.0:1790773501.507438:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773501.507441:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496172672:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790773501.507469:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:0.0:1790773501.507517:0:22685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xabf1cc0bc78436d9 00000004:00100000:0.0:1790773501.507532:0:22685:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790773501.507562:0:22685:0:(import.c:65:import_set_state_nolock()) ffff93d1425ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773501.507618:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3603:x1877761496172672:12345-0@lo:38:llog_process_th.0 Request processed in 174us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773501.507624:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790773501.507651:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d1437d5180 x1877761496172672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773501.507659:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773501.507664:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1790773501.507670:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773501.507674:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790773501.507676:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d1448aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773501.507681:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3603:1877761496172672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790773501.507915:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496173312:0@lo:400:kworker.0 00000100:00100000:3.0:1790773501.507928:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496172800:0@lo:400:kworker.0 00000020:01000004:3.0:1790773501.513188:0:25018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1790773501.513284:0:25018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff93d2512d19c0) 00000020:00000080:3.0:1790773501.513314:0:25018:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1790773501.513399:0:25018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d281bb3000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790773501.513404:0:25018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d281bb3000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1790773501.513406:0:25018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d281bb3000 3 00010000:00080000:3.0:1790773501.513435:0:25018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d2445dc000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1790773501.517748:0:25018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1790773501.518011:0:25018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1790773501.518059:0:25018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790773501.518074:0:25018:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xabf1cc0bc78436e7 00000100:00080000:3.0:1790773501.518083:0:25018:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790773501.518094:0:25018:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff93d2445dc000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1790773501.518130:0:25018:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d144547800 x1877761496174080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790773501.518156:0:25018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790773501.518445:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496174080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790773501.518526:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773501.518962:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174080 00000100:00100000:3.0:1790773501.518971:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174080 00000100:00100000:3.0:1790773501.519013:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790773501.519022:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3603:x1877761496174080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790773501.519049:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1790773501.519087:0:22685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xabf1cc0bc78436ee 00000004:00100000:3.0:1790773501.519103:0:22685:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790773501.519134:0:22685:0:(import.c:65:import_set_state_nolock()) ffff93d2445dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773501.519190:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3603:x1877761496174080:12345-0@lo:38:llog_process_th.0 Request processed in 168us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.519198:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790773501.519412:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d144547800 x1877761496174080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790773511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773501.519423:0:3603:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790773501.519430:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1790773501.519437:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1790773501.519441:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1790773501.519443:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d2445dc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773501.519449:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3603:1877761496174080:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1790773501.519610:0:25018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790773501.519658:0:25006:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790773501.519686:0:25006:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790773501.519699:0:25006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436c4 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773501.519718:0:25006:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7200/0xabf1cc0bc78436bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78436c4 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790773501.519774:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790773501.519776:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790773501.519778:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773501.519779:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773501.519781:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773501.519782:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773501.519783:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773501.519785:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773501.519786:0:25006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790773501.519790:0:25006:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790773501.519792:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790773501.519794:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790773501.519795:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790773501.519796:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790773501.519797:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790773501.519798:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790773501.519799:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790773501.519800:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790773501.519801:0:25006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790773501.519818:0:25006:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790773501.519832:0:25006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496174208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790773501.519869:0:25006:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773501.519896:0:25006:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163900 going to sleep for 11 seconds 00000100:00100000:2.0:1790773501.520108:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174208 00000100:00100000:2.0:1790773501.520114:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174208 00000100:00100000:2.0:1790773501.520154:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790773501.520161:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:25006:x1877761496174208:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790773501.520183:0:22678:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790773501.520195:0:22678:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790773501.529906:0:22678:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790773501.529929:0:22678:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790773501.530083:0:22699:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790773501.530089:0:22699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790773501.530113:0:22699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530133:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 24 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530154:0:22699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530162:0:22699:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530231:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530248:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 24 pid: 22678 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773501.530263:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496174336:0@lo:104: 00000100:00100000:2.0:1790773501.530328:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790773501.530382:0:22699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 24 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773501.530390:0:22699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 24 pid: 22677 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773501.530398:0:22699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496174464:0@lo:104: 00000100:00100000:2.0:1790773501.530420:0:22699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.530438:0:22699:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773501.530562:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174336 00000100:00100000:1.0:1790773501.530570:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174336 00000100:00100000:1.0:1790773501.530605:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174464 00000100:00100000:1.0:1790773501.530608:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174464 00000100:00100000:1.0:1790773501.530622:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773501.530630:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496174336:12345-0@lo:104: 00010000:00010000:1.0:1790773501.530641:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530692:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773501.530698:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:22699:x1877761496174336:12345-0@lo:104: Request processed in 69us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.530704:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773501.530722:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773501.530728:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496174464:12345-0@lo:104: 00010000:00010000:1.0:1790773501.530735:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530784:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773501.530789:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:22699:x1877761496174464:12345-0@lo:104: Request processed in 62us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.530796:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1790773501.530813:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773501.530819:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530826:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527c00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773501.530831:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530839:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773501.530846:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773501.530851:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773501.530877:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530883:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773501.530901:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530908:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527c00/0xabf1cc0bc7843589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843590 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530931:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773501.530934:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530939:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7e00 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:1.0:1790773501.530942:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530949:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790773501.530955:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773501.530960:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790773501.530971:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530977:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790773501.530990:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.530995:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7e00/0xabf1cc0bc784357b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843582 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531006:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773501.531008:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773501.531009:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773501.531015:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773501.531036:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496174592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773501.531062:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.531094:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496174720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773501.531114:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773501.531143:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174592 00000100:00100000:1.0:1790773501.531147:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174592 00010000:00010000:1.0:1790773501.531161:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 25 pid: 22678 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.531178:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174720 00000100:00100000:1.0:1790773501.531180:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174720 00010000:00010000:1.0:1790773501.531188:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 26 pid: 22677 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.531221:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773501.531227:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+26:3607:x1877761496174592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773501.531236:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773501.531241:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 26 pid: 22678 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531251:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 26 pid: 22678 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531264:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773501.531288:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+26:3607:x1877761496174592:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.531294:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773501.531306:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773501.531311:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+25:3604:x1877761496174720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773501.531326:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773501.531330:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 25 pid: 22677 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531338:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 25 pid: 22677 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531348:0:22670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531356:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790773501.531368:0:22670:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003092635s 00010000:00010000:1.0:1790773501.531372:0:22670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531379:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531385:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531392:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531397:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773501.531401:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531408:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531422:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531433:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773501.531473:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+25:3604:x1877761496174720:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773501.531479:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790773501.531522:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496174720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790773501.531547:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496174592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790773501.531567:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526c00/0xabf1cc0bc7843590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc7843589 expref: 24 pid: 22678 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.531577:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496174336:0@lo:104: 00010000:00010000:1.0:1790773501.531585:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d241526000/0xabf1cc0bc7843582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784357b expref: 23 pid: 22677 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773501.531593:0:22699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22699:1877761496174464:0@lo:104: 00010000:00010000:1.0:1790773501.531606:0:22699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531615:0:22699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531620:0:22699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773501.531627:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166e400/0xabf1cc0bc78436f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773501.531907:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:25006:x1877761496174208:12345-0@lo:253:mount.lustre.0 Request processed in 11744us (12035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773501.531916:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790773501.532008:0:25006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a65cda49-ef94-4b32-a3e4-9e24580a945a:25006:1877761496174208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790773501.532019:0:25006:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790773501.532022:0:25006:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790773501.532024:0:25006:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790773501.532025:0:25006:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790773501.532026:0:25006:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790773501.532027:0:25006:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790773501.532029:0:25006:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790773501.532030:0:25006:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790773501.532032:0:25006:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790773501.532034:0:25006:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790773501.532046:0:25006:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1790773501.534006:0:25006:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1790773501.536802:0:25006:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790773501.536812:0:25006:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790773501.536845:0:25006:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790773501.536905:0:25006:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790773501.536925:0:25006:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1790773501.536952:0:25006:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1790773501.539943:0:25006:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773501.540241:0:25006:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790773501.774064:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773501.776240:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496174848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773501.776310:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773501.778137:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174848 00000100:00100000:2.0:1790773501.778186:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174848 00000100:00100000:2.0:1790773501.778324:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790773501.778335:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496174848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790773501.778367:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773501.778445:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496174848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773501.778453:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790773501.778537:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496174848:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1790773502.549575:0:25072:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790773502.549859:0:25072:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790773502.797366:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773502.797389:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496174976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773502.797473:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773502.797525:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496174976 00000100:00100000:2.0:1790773502.797532:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496174976 00000100:00100000:2.0:1790773502.797576:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773502.797586:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496174976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773502.797611:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773502.797655:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496174976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773502.797662:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790773502.797711:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496174976:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790773502.799383:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790773502.925313:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790773502.925321:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d14482b000 from 14 10000000:01000000:1.0:1790773502.925328:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790773502.925377:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773502.925389:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773502.925400:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773502.925427:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773502.925521:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773502.925568:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773502.925750:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175104 00000100:00100000:0.0:1790773502.925766:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175104 00000100:00100000:0.0:1790773502.925821:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790773502.925830:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496175104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773502.925855:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773502.925869:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e7a00/0xabf1cc0bc7843703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78436fc expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.925894:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e7a00/0xabf1cc0bc7843703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78436fc expref: 23 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.925904:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e7a00/0xabf1cc0bc7843703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78436fc expref: 23 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.925913:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7a00, rc 0) 00000100:00100000:0.0:1790773502.925960:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496175104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773502.925968:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790773502.926027:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773502.926043:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843703 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.926051:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843703 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773502.926099:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790773502.926128:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773502.926143:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773502.926159:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175232 00000100:00100000:0.0:1790773502.926163:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175232 00000100:00100000:0.0:1790773502.926184:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790773502.926189:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496175232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790773502.926218:0:22678:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790773502.926234:0:22678:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790773502.926238:0:22678:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1790773502.926303:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496175232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773502.926309:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790773502.926336:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790773502.926394:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790773502.926400:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843703 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.926408:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a600/0xabf1cc0bc78436fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843703 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773502.926417:0:22680:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790773502.926419:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d24f7ba800 from 14 10000000:01000000:0.0:1790773502.926421:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790773502.926435:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.927283:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.927304:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773502.952591:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773502.952668:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773502.952713:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773502.952742:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175360 00000100:00100000:1.0:1790773502.952749:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175360 00000100:00100000:1.0:1790773502.952821:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790773502.952830:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496175360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773502.953080:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773502.953100:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc784370a expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773502.953129:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc784370a expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773502.953141:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12ae00/0xabf1cc0bc7843711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784370a expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773502.953150:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ae00, rc 0) 00000100:00100000:1.0:1790773502.953199:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496175360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 370us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773502.953236:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1790773502.954885:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773502.954917:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843711 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773502.954930:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843711 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773502.955012:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790773502.955071:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773502.955118:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790773502.955415:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175488 00000100:00100000:3.0:1790773502.955424:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175488 00000100:00100000:3.0:1790773502.955798:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790773502.955809:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496175488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790773502.955831:0:22677:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790773502.955864:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790773502.955868:0:22677:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1790773502.955968:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496175488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773502.955976:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790773502.965057:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496175488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1790773502.965156:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790773502.965167:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843711 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773502.965188:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e6400/0xabf1cc0bc784370a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843711 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773503.823384:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773503.823859:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790773503.823883:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496175616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773503.823960:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773503.824041:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175616 00000100:00100000:1.0:1790773503.824050:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175616 00000100:00100000:1.0:1790773503.824108:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790773503.824118:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496175616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773503.824173:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790773503.824261:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496175616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773503.824269:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790773503.824316:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496175616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790773503.824934:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496175744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773503.824969:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773503.825025:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175744 00000100:00100000:2.0:1790773503.825031:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175744 00000100:00100000:2.0:1790773503.825070:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790773503.825077:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496175744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773503.825102:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773503.825358:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496175744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 281us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773503.825366:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790773503.825425:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496175744:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1790773504.270004:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790773504.845475:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773505.869400:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773506.895039:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496176000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773506.895116:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.895224:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176000 00000100:00100000:0.0:1790773506.895232:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176000 00000100:00100000:0.0:1790773506.895283:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790773506.895292:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496176000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790773506.895324:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773506.895371:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496176000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.895379:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790773506.895403:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773506.895438:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496176000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773506.895468:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790773506.895475:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496175872:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.895524:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.895575:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496175872 00000100:00100000:0.0:1790773506.895579:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496175872 00000100:00100000:0.0:1790773506.895605:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773506.895612:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3604:x1877761496175872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.895648:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3604:x1877761496175872:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.895656:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790773506.895692:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496175872:0@lo:400:kworker.0 00000100:00080000:1.0:1790773506.895844:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773506.895849:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790773506.895853:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773506.895863:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d143285000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773506.895885:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cce00 x1877761496176256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790773506.895931:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790773506.895935:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790773506.895936:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790773506.895942:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93d281bd7000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1790773506.895952:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d2526cdc00 x1877761496176768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1790773506.896131:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773506.897896:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496176256:0@lo:8:kworker.0 00000100:00100000:0.0:1790773506.897969:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.898014:0:3603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496176768:0@lo:8:kworker.0 00000100:00100000:0.0:1790773506.898039:0:3603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.898091:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496176128:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.898579:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773506.898598:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176256 00000100:00100000:2.0:1790773506.898615:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176256 00000100:00100000:0.0:1790773506.898618:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496176896:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.898645:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773506.898651:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176768 00000100:00100000:2.0:1790773506.898653:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176768 00000100:00100000:0.0:1790773506.898663:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496177408:0@lo:400:kworker.0 00000100:00100000:2.0:1790773506.898669:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773506.898676:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496176256:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790773506.898681:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.898700:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790773506.898705:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496176640:0@lo:400:kworker.0 00010000:00080000:2.0:1790773506.898710:0:24188:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000100:00100000:0.0:1790773506.898740:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1790773506.898751:0:24188:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xabf1cc0bc7843718 00000100:00100000:0.0:1790773506.898751:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496177280:0@lo:400:kworker.0 00002000:00100000:2.0:1790773506.898763:0:24188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d1448ad000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790773506.898767:0:24188:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1790773506.898767:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1790773506.898770:0:24188:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1790773506.898790:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176128 00000100:00100000:0.0:1790773506.898794:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176128 00000100:00100000:0.0:1790773506.898831:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773506.898836:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.898886:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496176128:12345-0@lo:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.898892:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773506.898917:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176896 00000100:00100000:0.0:1790773506.898921:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176896 00000100:00100000:0.0:1790773506.898938:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177408 00000100:00100000:0.0:1790773506.898940:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177408 00000100:00100000:0.0:1790773506.898963:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177280 00000100:00100000:0.0:1790773506.898966:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177280 00000100:00100000:0.0:1790773506.898980:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773506.898986:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496176896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.899017:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496176896:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.899024:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790773506.899034:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790773506.899040:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496177408:12345-0@lo:400:kworker.0 00002000:00080000:2.0:1790773506.899053:0:24188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1790773506.899063:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496177408:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.899068:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790773506.899076:0:24188:0:(import.c:65:import_set_state_nolock()) ffff93d1448a9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790773506.899078:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790773506.899083:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496177280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.899104:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496177280:12345-0@lo:400:kworker.0 Request processed in 21us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773506.899112:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3603:x1877761496176256:12345-0@lo:8:kworker.0 Request processed in 436us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773506.899118:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790773506.899129:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176640 00000100:00100000:2.0:1790773506.899132:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176640 00000100:00100000:2.0:1790773506.899151:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773506.899156:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496176640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773506.899184:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496176640:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773506.899190:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790773506.899200:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790773506.899230:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3603:x1877761496176768:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790773506.899247:0:24188:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:2.0:1790773506.899262:0:24188:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xabf1cc0bc784371f 00002000:00100000:2.0:1790773506.899269:0:24188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff93d1448a8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b04 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1790773506.899279:0:24188:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1790773506.899281:0:24188:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790773506.899312:0:24188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1790773506.899324:0:24188:0:(import.c:65:import_set_state_nolock()) ffff93d1448af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773506.899353:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3603:x1877761496176768:12345-0@lo:8:kworker.0 Request processed in 147us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773506.899359:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773506.899388:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790773506.899406:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cce00 x1877761496176256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.899412:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496176512:0@lo:400:kworker.0 00000100:00080000:2.0:1790773506.899420:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790773506.899427:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790773506.899432:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790773506.899434:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d143285000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790773506.899441:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790773506.899447:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790773506.899451:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3603:1877761496176256:0@lo:8:kworker.0 00000100:00100000:0.0:1790773506.899457:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496177152:0@lo:400:kworker.0 00010000:00080000:2.0:1790773506.899463:0:3603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cdc00 x1877761496176768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790773531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790773506.899472:0:3603:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00100000:0.0:1790773506.899475:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790773506.899477:0:3603:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790773506.899479:0:3603:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790773506.899481:0:3603:0:(import.c:65:import_set_state_nolock()) ffff93d281bd7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790773506.899491:0:3603:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790773506.899491:0:3605:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790773506.899495:0:3603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3603:1877761496176768:0@lo:8:kworker.0 00000100:00100000:0.0:1790773506.899497:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496176384:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.899515:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.899530:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496177024:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.899549:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790773506.899595:0:22710:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1790773506.899679:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177152 00000100:00100000:1.0:1790773506.899684:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177152 00000100:00100000:1.0:1790773506.899725:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176384 00000100:00100000:1.0:1790773506.899729:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176384 00000100:00100000:1.0:1790773506.899741:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177024 00000100:00100000:1.0:1790773506.899744:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177024 00000100:00100000:1.0:1790773506.899756:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773506.899762:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496177152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773506.899798:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496177152:12345-0@lo:400:kworker.0 Request processed in 36us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.899803:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790773506.899815:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773506.899820:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496176384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773506.899845:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1877761496176384:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.899850:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790773506.899862:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790773506.899867:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496177024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773506.899893:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1877761496177024:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.899899:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790773506.899911:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22710:1877761496177664:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790773506.899939:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.899954:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143e37cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1790773506.899970:0:23427:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790773506.900035:0:23427:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 649701830345ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790773506.900042:0:23427:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:0.0:1790773506.900066:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790773506.900071:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773506.900073:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773506.900082:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496177536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773506.900107:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773506.900351:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496176512 00000100:00100000:0.0:1790773506.900356:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496176512 00000100:00100000:0.0:1790773506.900378:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773506.900383:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.900414:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496176512:12345-0@lo:400:kworker.0 Request processed in 30us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.900428:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790773506.900458:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cea00 x1877761496176384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900468:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3605:1877761496176384:0@lo:400:kworker.0 00010000:00080000:0.0:1790773506.900478:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6d500 x1877761496177024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900486:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3605:1877761496177024:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.900495:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496176512:0@lo:400:kworker.0 00010000:00080000:0.0:1790773506.900503:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6f480 x1877761496177152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900511:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496177152:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.900539:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177536 00000100:00100000:0.0:1790773506.900543:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177536 00000100:00100000:0.0:1790773506.900571:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790773506.900577:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496177536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790773506.900596:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000004:00080000:2.0:1790773506.900667:0:23428:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790773506.900684:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496177920:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1790773506.900696:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3604:x1877761496177536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773506.900702:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773506.900731:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790773506.900731:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773506.900747:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c7420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773506.900757:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496176640:0@lo:400:kworker.0 00010000:00080000:0.0:1790773506.900769:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6c000 x1877761496177280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900787:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496177280:0@lo:400:kworker.0 00000100:00100000:0.0:1790773506.900799:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496176128:0@lo:400:kworker.0 00010000:00080000:0.0:1790773506.900808:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6e680 x1877761496176896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900815:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496176896:0@lo:400:kworker.0 00010000:00080000:0.0:1790773506.900824:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6ce00 x1877761496177408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.900830:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496177408:0@lo:400:kworker.0 00000004:00080000:0.0:1790773506.900867:0:22709:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1790773506.900897:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177664 00000004:00080000:0.0:1790773506.900916:0:22709:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 649702710974ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790773506.900921:0:22709:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1790773506.901735:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177664 00000100:00100000:2.0:1790773506.901781:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177920 00000100:00100000:2.0:1790773506.901785:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177920 00000100:00100000:2.0:1790773506.901816:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790773506.901823:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22710:x1877761496177664:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790773506.902129:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790773506.902140:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23428:x1877761496177920:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1790773506.902350:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790773506.902385:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d281b9d880 x1877761496177536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773506.902394:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496177792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773506.902403:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496177536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773506.902440:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773506.904016:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496177792 00000100:00100000:1.0:1790773506.904030:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496177792 00000100:00100000:1.0:1790773506.904085:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773506.904095:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3605:x1877761496177792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790773506.904119:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000004:00080000:0.0:1790773506.904202:0:22663:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1790773506.904223:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3605:x1877761496177792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.904233:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790773506.904283:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447df100 x1877761496177792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790773522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773506.904304:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496177792:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1790773506.905834:0:24189:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1790773506.905844:0:24189:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1790773506.905850:0:24189:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:2.0:1790773506.916425:0:23417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1790773506.920082:0:24190:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1790773506.920094:0:24190:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790773506.920200:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23428:x1877761496177920:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18058us (19479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.920234:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1790773506.920304:0:23428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2447dc000 x1877761496177920/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790773522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773506.920320:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2447dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496177920:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1790773506.920335:0:23428:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1790773506.920376:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496178048:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1790773506.920481:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773506.930387:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178048 00000100:00100000:1.0:1790773506.930405:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178048 00000100:00100000:1.0:1790773506.930475:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790773506.930486:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23428:x1877761496178048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1790773506.930529:0:24585:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1790773506.930604:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23428:x1877761496178048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 121us (10123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773506.930612:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00010000:0.0:1790773506.932782:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773506.932797:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.932817:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773506.932823:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773506.932829:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.932861:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.932872:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.932880:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.932902:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790773506.933953:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26bebf0c0 going to sleep for 11 seconds 00010000:00080000:3.0:1790773506.934003:0:23428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d280f6ea00 x1877761496178048/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790773522 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790773506.934019:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d280f6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496178048:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1790773506.934036:0:23428:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1790773506.934088:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496178176:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1790773506.934152:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773506.934180:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163840 going to sleep for 11 seconds 00002000:00010000:3.0:1790773506.937459:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.937475:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.937492:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.937496:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.937503:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.937529:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.937558:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.937567:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.937588:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790773506.938758:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790773506.938779:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938792:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773506.938798:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938809:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938832:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938840:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc7843726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938863:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773506.938867:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938874:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773506.938877:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.938885:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790773506.939231:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.939238:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.939249:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.939253:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.939258:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.939268:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.939277:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.939284:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.939305:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790773506.941307:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178176 00000100:00100000:0.0:1790773506.941330:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178176 00000100:00100000:0.0:1790773506.941400:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790773506.941410:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23428:x1877761496178176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1790773506.941461:0:24190:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:1.0:1790773506.942455:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942468:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e7cc56/0xabf1cc0bc784372d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942496:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773506.942500:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942519:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773506.942523:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942532:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942542:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942548:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000240212df/0xabf1cc0bc7843734 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.942562:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773506.942563:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773506.942577:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773506.942911:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.946324:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.946338:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.946356:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.946360:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.946366:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.946380:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.946391:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.946399:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.946429:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790773506.946639:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773506.946647:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.946654:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:1.0:1790773506.946659:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.946668:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.946686:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.946694:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784373b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773506.946730:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773506.946733:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790773506.946734:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.953432:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.953446:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953466:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.953478:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.953485:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953512:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953525:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953534:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953568:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.953580:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.953586:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953594:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.953599:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953608:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953624:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953775:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc7843742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.953797:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.953799:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.953801:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.955020:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.955030:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955044:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.955048:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.955053:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955065:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955073:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955080:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955099:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.955108:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.955119:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955801:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.955809:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955819:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955834:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955840:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843749 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.955857:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.955859:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.955860:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.957067:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.957077:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957093:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.957097:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.957103:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957821:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957835:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957843:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957862:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.957874:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.957880:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957887:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.957891:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957900:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957916:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957923:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc7843750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.957949:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.957951:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.957952:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.959761:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.959774:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.959791:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.959795:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.959802:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.959816:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.959825:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.959832:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.959851:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773506.960095:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773506.960103:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.960112:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773506.960117:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.960195:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.960250:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.960258:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.960287:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.960301:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.960305:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773506.961086:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773506.961096:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.961111:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773506.961115:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773506.961120:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.961456:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.961468:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.961476:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.961505:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.961853:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.961859:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.961878:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.961883:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.961891:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.961906:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.961914:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000685603a2/0xabf1cc0bc784375e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.961933:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.961935:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.961937:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773506.963842:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773506.963853:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.963870:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773506.963875:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773506.963881:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.963894:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.963903:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.963910:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.963936:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.964103:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.964112:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.964120:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.964124:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.964312:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.964352:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.964358:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d75c8bea/0xabf1cc0bc7843765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.964379:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.964381:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.964383:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.967307:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.967321:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967338:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.967342:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.967349:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967363:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967373:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967381:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967420:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.967433:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.967440:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967448:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.967452:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967461:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967476:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967483:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab7ce6bf/0xabf1cc0bc784376c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.967505:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.967507:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.967508:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.968906:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.968918:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.968933:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.968947:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.968953:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.968966:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.968975:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.968984:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969001:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773506.969012:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773506.969017:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969024:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773506.969028:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969035:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969049:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969067:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.969084:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.969086:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773506.969088:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.970641:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.970651:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.970668:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.970672:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.970677:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.970688:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.970695:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.970704:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.970741:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773506.970874:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773506.970883:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.970893:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773506.970898:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.970987:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.971005:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.971024:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012431c86/0xabf1cc0bc784377a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.971044:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773506.971046:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773506.971047:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.972862:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.972882:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.972898:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.972902:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.972908:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.972922:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.972931:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.972938:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.972967:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773506.972994:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773506.973004:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.973014:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773506.973019:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.973028:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.973043:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.973050:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079624829/0xabf1cc0bc7843781 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773506.973070:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773506.973072:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773506.973074:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.979742:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.979759:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.979778:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.979783:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.979790:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.979805:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.979825:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.979834:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.979853:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773506.982579:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773506.982594:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.982610:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773506.982624:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.982636:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.982659:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.982667:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ca5c93/0xabf1cc0bc7843788 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.982688:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.982690:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.982692:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.984812:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.984825:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.984842:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.984847:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.984855:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.984869:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.984879:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.984888:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.984933:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773506.984999:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773506.985007:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.985016:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773506.985020:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.985029:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.985047:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.985063:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb30bf7b/0xabf1cc0bc784378f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.985084:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.985086:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.985088:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790773506.987883:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790773506.987899:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.987920:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1790773506.987924:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773506.987931:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.987948:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.987959:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.987967:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773506.987995:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773506.988323:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773506.988331:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.988341:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773506.988346:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.988355:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.988373:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.988381:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042c2b8c0/0xabf1cc0bc7843796 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773506.988401:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.988402:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773506.988404:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773507.003303:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773507.004790:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.004809:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=649s v=(0 0) 00010000:00010000:2.0:1790773507.004814:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773507.004821:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773507.004872:0:25007:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1790773507.004902:0:25007:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790773507.004907:0:25007:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1790773507.005006:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.005020:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.005028:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.005052:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790773507.005075:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23428:x1877761496178176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63660us (70916us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790773507.005086:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1790773507.005124:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773507.005132:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.005143:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773507.005148:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.005159:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.005176:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.005184:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc784379d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.005377:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.005379:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.005380:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773507.005959:0:23428:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790773507.005970:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23428:1877761496178176:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790773507.005987:0:23428:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1790773507.006033:0:23428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23428:1877761496178304:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1790773507.006072:0:23428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773507.006100:0:23428:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c742780 going to sleep for 11 seconds 00000100:00100000:0.0:1790773507.006665:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178304 00000100:00100000:0.0:1790773507.006683:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178304 00000100:00100000:0.0:1790773507.006742:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790773507.006752:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23428:x1877761496178304:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1790773507.006821:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23428:x1877761496178304:12345-0@lo:900:osp-pre-1-1.0 Request processed in 70us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773507.006828:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790773507.006869:0:23428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d2526cdf80 x1877761496178304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790773523 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773507.006881:0:23428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23428:1877761496178304:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1790773507.007107:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773507.007115:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007132:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773507.007137:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773507.007143:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007156:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007167:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007176:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007489:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773507.007503:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773507.007509:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007517:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773507.007521:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007531:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007547:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007555:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8911e24/0xabf1cc0bc78437a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.007574:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.007575:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.007577:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773507.008057:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773507.008065:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008076:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773507.008086:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773507.008091:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008101:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008109:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008116:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008133:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790773507.008142:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790773507.008146:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008153:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773507.008155:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008162:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008172:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.008189:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac5e736/0xabf1cc0bc78437ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.009316:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.009321:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773507.009323:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790773507.010584:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790773507.010595:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.010611:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1790773507.010616:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773507.010621:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.010708:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.010727:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.010734:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773507.010760:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773507.010875:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773507.010890:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.010900:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6c00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773507.010905:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.010915:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.010932:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.010938:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d428aeca/0xabf1cc0bc78437b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.010955:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.010956:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.010958:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773507.023817:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.023835:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.023859:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.023864:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.023871:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.023894:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.023905:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.023913:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.023938:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773507.024358:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773507.024376:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.024386:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773507.024391:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.024420:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.024465:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.024484:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060df18b3/0xabf1cc0bc78437b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.024839:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.024843:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.024845:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773507.025177:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.025185:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025197:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.025201:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.025220:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025338:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025348:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025368:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025383:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790773507.025904:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.025911:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025921:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.025925:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.025929:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025938:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025945:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025952:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.025976:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790773507.026234:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773507.026241:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026261:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ba00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.026265:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026275:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026290:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026296:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ff3bd0f/0xabf1cc0bc78437c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026314:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773507.026317:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026324:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a200 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.026327:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026334:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026341:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026352:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bec46ce/0xabf1cc0bc78437c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.026363:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.026365:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.026366:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773507.026731:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.026738:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.026753:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.026756:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.026760:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.026772:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.026780:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.026790:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026801:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790773507.026814:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790773507.026818:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026828:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773507.026831:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026840:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026854:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026862:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d352d4fd/0xabf1cc0bc78437ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.026895:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.026898:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.026900:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.027800:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773507.028624:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.028648:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.028665:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.028670:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.028678:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.028692:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.028729:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.028737:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.028762:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790773507.031003:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773507.031016:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.031031:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773507.031036:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.031048:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.031072:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.031079:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad13755/0xabf1cc0bc78437d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.031110:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.031112:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.031114:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790773507.032482:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790773507.032495:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.032521:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1790773507.032527:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773507.032532:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.032547:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.032557:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.032565:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773507.032599:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773507.033639:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773507.033649:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.033660:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12aa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.033665:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.033676:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.033696:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.033703:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edbcaa1a/0xabf1cc0bc78437dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.033735:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.033737:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.033749:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773507.034576:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773507.034587:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.034618:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=649s v=(0 0) 00010000:00010000:2.0:1790773507.034622:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773507.034629:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.034641:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.034650:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.034657:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.034680:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773507.034898:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773507.034905:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.034913:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e600 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.034918:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.034927:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.034941:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.034949:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1688cf2/0xabf1cc0bc78437e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.034965:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.034967:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.034969:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773507.035443:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773507.035450:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.035460:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=649s v=(0 0) 00010000:00010000:2.0:1790773507.035465:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773507.035470:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.035480:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.035500:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.035507:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.035526:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790773507.035596:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773507.035602:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.035609:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ee00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.035613:0:22671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.035644:0:22671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.035658:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.035666:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000632bcef9/0xabf1cc0bc78437ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.035681:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.035682:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.035684:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790773507.036085:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773507.036093:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036102:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=649s v=(0 0) 00010000:00010000:2.0:1790773507.036105:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773507.036109:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036130:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036138:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036145:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036365:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790773507.036785:0:24189:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790773507.036794:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036805:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=649s v=(0 0) 00010000:00010000:2.0:1790773507.036808:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773507.036812:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036822:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036830:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773507.036837:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038002:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790773507.038015:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038027:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.038031:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038042:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038059:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038082:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023bdf60d/0xabf1cc0bc78437f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038105:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773507.038109:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038351:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773507.038355:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038363:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038375:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.038384:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.038387:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773507.038389:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773507.039904:0:24189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790773507.039919:0:24189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22190cf/0xabf1cc0bc78437f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773507.039948:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790773507.040140:0:24189:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1790773507.040460:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22710:x1877761496177664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 138633us (140515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773507.040471:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773507.040521:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22710:1877761496177664:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790773507.040543:0:22710:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1790773507.040585:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22710:1877761496178432:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790773507.040695:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773507.040731:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790773507.040756:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178432 00000100:00100000:3.0:1790773507.040763:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178432 00000100:00100000:3.0:1790773507.040815:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773507.040825:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22710:x1877761496178432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790773507.040863:0:24188:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790773507.048040:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22710:x1877761496178432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7206us (7336us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790773507.048056:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773507.048148:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22710:1877761496178432:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1790773507.048168:0:22710:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:02000400:3.0:1790773507.743532:0:25362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1790773507.917850:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790773507.917880:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496178560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790773507.917963:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773507.918050:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178560 00000100:00100000:2.0:1790773507.918059:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178560 00000100:00100000:2.0:1790773507.918130:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790773507.918140:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496178560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1790773507.918169:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790773507.918250:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496178560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773507.918258:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790773507.918422:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d2526cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496178560:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1790773507.922512:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790773508.707465:0:25414:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790773508.707896:0:25414:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790773508.943889:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496178688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773508.943976:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773508.948304:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178688 00000100:00100000:1.0:1790773508.948322:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178688 00000100:00100000:1.0:1790773508.948406:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773508.948416:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496178688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1790773508.948456:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790773508.948560:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496178688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773508.948568:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790773508.948848:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496178688:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790773508.949239:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773508.949289:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496178816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773508.949332:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773508.949404:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178816 00000100:00100000:2.0:1790773508.949409:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178816 00000100:00100000:2.0:1790773508.949444:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790773508.949451:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496178816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790773508.949470:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790773508.949503:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496178816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773508.949509:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790773508.949568:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496178816:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1790773509.785852:0:25464:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790773509.786125:0:25464:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790773509.965475:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773510.029939:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790773510.122771:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.122938:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536320 00000100:00100000:3.0:1790773510.122949:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536320 00000100:00100000:3.0:1790773510.123005:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1790773510.123012:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1877761484536320:12345-192.168.202.19@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790773510.123060:0:22677:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c41b0d0c-f917-4aa4-9d74-ef94f8de06ab@192.168.202.19@tcp t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:3.0:1790773510.123096:0:22677:0:(genops.c:1384:class_connect()) connect: client c41b0d0c-f917-4aa4-9d74-ef94f8de06ab, cookie 0xabf1cc0bc78437ff 00000100:00080000:3.0:1790773510.123296:0:22677:0:(import.c:65:import_set_state_nolock()) ffff93d2445de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773510.123451:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+5:2396:x1877761484536320:12345-192.168.202.19@tcp:250:mount.lustre.0 Request processed in 437us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.123461:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1790773510.132416:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.132571:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536448 00000100:00100000:0.0:1790773510.132582:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536448 00000100:00100000:0.0:1790773510.132640:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:0.0:1790773510.132651:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+5:18013:x1877761484536448:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773510.132697:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773510.132717:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e7800/0xabf1cc0bc7843806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c135 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.132752:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e7800/0xabf1cc0bc7843806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c135 expref: 6 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.132764:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e7800/0xabf1cc0bc7843806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c135 expref: 6 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.132774:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7800, rc 0) 00000100:00100000:0.0:1790773510.132842:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+6:18013:x1877761484536448:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.132850:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:1.0:1790773510.137228:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.137349:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536576 00000100:00100000:0.0:1790773510.137369:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536576 00000100:00100000:0.0:1790773510.137578:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1790773510.137588:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+6:18013:x1877761484536576:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790773510.137754:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+6:18013:x1877761484536576:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 166us (561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790773510.137763:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1790773510.146071:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.147147:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536704 00000100:00100000:0.0:1790773510.147162:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536704 00000100:00100000:0.0:1790773510.147333:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:0.0:1790773510.147347:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+6:18013:x1877761484536704:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773510.147385:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773510.147405:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e6000/0xabf1cc0bc784380d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c13c expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.147436:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e6000/0xabf1cc0bc784380d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c13c expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.147453:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e6000/0xabf1cc0bc784380d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c13c expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.147463:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6000, rc 0) 00000100:00100000:0.0:1790773510.147536:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+7:18013:x1877761484536704:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 192us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.147543:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:2.0:1790773510.154569:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.154662:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536832 00000100:00100000:1.0:1790773510.154676:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536832 00000100:00100000:1.0:1790773510.154756:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:1.0:1790773510.154767:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+7:18013:x1877761484536832:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790773510.154949:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18013:x1877761484536832:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 183us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.154957:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:1.0:1790773510.158349:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.162578:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484536960 00000100:00100000:0.0:1790773510.162595:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484536960 00000100:00100000:2.0:1790773510.163859:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1790773510.163877:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18013:x1877761484536960:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773510.164069:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18013:x1877761484536960:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 195us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773510.164089:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1790773510.169946:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.170133:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537088 00000100:00100000:0.0:1790773510.170143:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537088 00000100:00100000:0.0:1790773510.170246:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:0.0:1790773510.170256:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537088:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773510.171915:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537088:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 1651us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773510.171931:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:0.0:1790773510.199456:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773510.199697:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537216 00000100:00100000:2.0:1790773510.199707:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537216 00000100:00100000:2.0:1790773510.199763:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:2.0:1790773510.199772:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537216:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773510.199959:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537216:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 186us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773510.199967:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1790773510.209029:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.209198:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537344 00000100:00100000:3.0:1790773510.209251:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537344 00000100:00100000:3.0:1790773510.209314:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:3.0:1790773510.209324:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537344:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773510.209749:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18032:x1877761484537344:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 425us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.209758:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:2.0:1790773510.221200:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.221331:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537472 00000100:00100000:0.0:1790773510.221340:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537472 00000100:00100000:0.0:1790773510.221389:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773510.221406:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+8:18013:x1877761484537472:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773510.221441:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773510.221461:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e6200/0xabf1cc0bc7843814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c16d expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.221495:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e6200/0xabf1cc0bc7843814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c16d expref: 9 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.221508:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e6200/0xabf1cc0bc7843814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c16d expref: 9 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773510.221518:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6200, rc 0) 00000100:00100000:0.0:1790773510.221577:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+9:18013:x1877761484537472:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 174us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.221583:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1790773510.226133:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.226302:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537600 00000100:00100000:3.0:1790773510.226314:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537600 00000100:00100000:3.0:1790773510.226384:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:3.0:1790773510.226409:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d244321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+9:18013:x1877761484537600:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790773510.226439:0:22677:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790773510.226466:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790773510.226470:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790773510.226473:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790773510.226477:0:22677:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1790773510.226479:0:22677:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1790773510.234346:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d244321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+9:18013:x1877761484537600:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 7942us (8213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.234385:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:2.0:1790773510.240165:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.240271:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537728 00000100:00100000:1.0:1790773510.240281:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537728 00000100:00100000:1.0:1790773510.240348:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:1.0:1790773510.240359:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+9:18013:x1877761484537728:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790773510.240387:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773510.240406:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c174 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.240438:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 10 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.240448:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 10 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.240456:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12ba00, rc 0) 00000100:00100000:1.0:1790773510.240710:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18013:x1877761484537728:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 352us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.240719:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:2.0:1790773510.248694:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.248787:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537856 00000100:00100000:3.0:1790773510.248798:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537856 00000100:00100000:3.0:1790773510.248860:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:3.0:1790773510.248871:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18013:x1877761484537856:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790773510.249061:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18013:x1877761484537856:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 191us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.249070:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:3.0:1790773510.252085:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.252179:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484537984 00000100:00100000:0.0:1790773510.252190:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484537984 00000100:00100000:0.0:1790773510.252279:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:0.0:1790773510.252288:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18013:x1877761484537984:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790773510.252447:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18013:x1877761484537984:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.252456:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:2.0:1790773510.255959:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.256287:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538112 00000100:00100000:1.0:1790773510.256299:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538112 00000100:00100000:1.0:1790773510.256364:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:1.0:1790773510.256383:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18037:x1877761484538112:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790773510.256552:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18037:x1877761484538112:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 178us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.256560:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:2.0:1790773510.260088:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.260182:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538240 00000100:00100000:3.0:1790773510.260193:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538240 00000100:00100000:3.0:1790773510.260285:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:3.0:1790773510.260295:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18037:x1877761484538240:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790773510.260459:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281bbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18037:x1877761484538240:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.260468:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:2.0:1790773510.291557:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773510.291604:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.293848:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538368 00000100:00100000:1.0:1790773510.293882:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538368 00000100:00100000:1.0:1790773510.293937:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538624 00000100:00100000:1.0:1790773510.293940:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538624 00000100:00100000:1.0:1790773510.293958:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1790773510.293967:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1877761484538368:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790773510.293999:0:22683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8a9031e1-1696-4ed7-99a1-a67115ed7fee@192.168.202.19@tcp t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:1.0:1790773510.294050:0:22683:0:(genops.c:1384:class_connect()) connect: client 8a9031e1-1696-4ed7-99a1-a67115ed7fee, cookie 0xabf1cc0bc7843822 00000004:00100000:1.0:1790773510.294075:0:22683:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790773510.294334:0:22683:0:(import.c:65:import_set_state_nolock()) ffff93d272c4f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773510.294482:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2396:x1877761484538368:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 514us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.294491:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1790773510.294513:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1790773510.294518:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1877761484538624:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790773510.294536:0:22683:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8a9031e1-1696-4ed7-99a1-a67115ed7fee@192.168.202.19@tcp t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:1.0:1790773510.294567:0:22683:0:(genops.c:1384:class_connect()) connect: client 8a9031e1-1696-4ed7-99a1-a67115ed7fee, cookie 0xabf1cc0bc7843829 00000004:00100000:1.0:1790773510.294581:0:22683:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790773510.295327:0:22683:0:(import.c:65:import_set_state_nolock()) ffff93d272c4e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790773510.295370:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2396:x1877761484538624:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 848us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.297502:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1790773510.300732:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773510.300781:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.300871:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538496 00000100:00100000:0.0:1790773510.300884:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538496 00000100:00100000:0.0:1790773510.300962:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538880 00000100:00100000:0.0:1790773510.300966:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538880 00000100:00100000:0.0:1790773510.300984:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773510.300993:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:0:x1877761484538496:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773510.301049:0:22684:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773510.301139:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:0:x1877761484538496:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 147us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.301146:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773510.301166:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773510.301172:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484538880:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773510.301184:0:22684:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773510.301229:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484538880:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 34us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773510.301235:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:2.0:1790773510.301699:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773510.309071:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773510.309164:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.309343:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484538752 00000100:00100000:1.0:1790773510.309353:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484538752 00000100:00100000:1.0:1790773510.309420:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539008 00000100:00100000:1.0:1790773510.309424:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539008 00000100:00100000:1.0:1790773510.309441:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1790773510.309449:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:0:x1877761484538752:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790773510.309520:0:22685:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773510.309603:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27c3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:0:x1877761484538752:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 154us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.309610:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1790773510.309628:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1790773510.309635:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539008:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790773510.309663:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539008:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.309670:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00080000:2.0:1790773510.309782:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773510.314804:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.314849:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773510.314932:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773510.315135:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539136 00000100:00100000:2.0:1790773510.315157:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539136 00000100:00100000:2.0:1790773510.315197:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539264 00000100:00100000:2.0:1790773510.315201:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539264 00000100:00100000:2.0:1790773510.315248:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773510.315257:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484539136:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790773510.315290:0:24189:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8a9031e1-1696-4ed7-99a1-a67115ed7fee@192.168.202.19@tcp t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:2.0:1790773510.315320:0:24189:0:(genops.c:1384:class_connect()) connect: client 8a9031e1-1696-4ed7-99a1-a67115ed7fee, cookie 0xabf1cc0bc7843830 00002000:00100000:2.0:1790773510.315332:0:24189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a9031e1-1696-4ed7-99a1-a67115ed7fee/ffff93d1448ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773510.315349:0:24189:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790773510.315583:0:24189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790773510.315614:0:24189:0:(import.c:65:import_set_state_nolock()) ffff93d1448ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773510.315680:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2396:x1877761484539136:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 423us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773510.315697:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773510.315716:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1790773510.315721:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1877761484539264:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790773510.315738:0:24189:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8a9031e1-1696-4ed7-99a1-a67115ed7fee@192.168.202.19@tcp t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:2.0:1790773510.315755:0:24189:0:(genops.c:1384:class_connect()) connect: client 8a9031e1-1696-4ed7-99a1-a67115ed7fee, cookie 0xabf1cc0bc7843837 00002000:00100000:2.0:1790773510.315760:0:24189:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a9031e1-1696-4ed7-99a1-a67115ed7fee/ffff93d1448a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790773510.315772:0:24189:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790773510.315896:0:24189:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790773510.315916:0:24189:0:(import.c:65:import_set_state_nolock()) ffff93d1448aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773510.315941:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2396:x1877761484539264:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 219us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773510.315947:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773510.320436:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539392 00000100:00100000:3.0:1790773510.320589:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539392 00000100:00100000:3.0:1790773510.320667:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1790773510.320678:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539392:12345-192.168.202.19@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790773510.320808:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539392:12345-192.168.202.19@tcp:900:mount.lustre.0 Request processed in 131us (6014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773510.320816:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773510.327250:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773510.327361:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539520 00000100:00100000:3.0:1790773510.327396:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539520 00000100:00100000:2.0:1790773510.327586:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1790773510.327598:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539520:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790773510.329752:0:22687:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2037us 00000004:00200000:1.0:1790773510.359121:0:22687:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790773510.359288:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18013:x1877761484539520:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 31686us (32082us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.359305:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773510.509368:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773510.509524:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539648 00000100:00100000:1.0:1790773510.509535:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539648 00000100:00100000:1.0:1790773510.509595:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1790773510.509611:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18060:x1877761484539648:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:1.0:1790773510.509631:0:22685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773510.509656:0:22685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12aa00/0xabf1cc0bc784383e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c1a5 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509766:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509781:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509813:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790773510.509865:0:22685:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790773510.509869:0:22685:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790773510.509907:0:22685:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509932:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12aa00/0xabf1cc0bc784383e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1a5 expref: 8 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509947:0:22685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1a5 expref: 7 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773510.509954:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:1.0:1790773510.509957:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790773510.509959:0:22685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773510.510040:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d281b9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18060:x1877761484539648:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 432us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773510.510047:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:2.0:1790773510.989586:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773512.013889:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773512.013912:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496179072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773512.013996:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.014133:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179072 00000100:00100000:2.0:1790773512.014141:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179072 00000100:00100000:2.0:1790773512.014197:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773512.014223:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496179072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790773512.014250:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790773512.014300:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1877761496179072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773512.014307:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773512.014348:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496179072:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790773512.014463:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790773512.014871:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773512.014891:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496178944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790773512.014933:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.014972:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496178944 00000100:00100000:1.0:1790773512.014976:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496178944 00000100:00100000:1.0:1790773512.015007:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773512.015015:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496178944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790773512.015046:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790773512.015081:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496178944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.015089:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773512.015107:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496179328:0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015134:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.015146:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496179584:0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015163:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496179840:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015170:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.015184:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.015186:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496180096:0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015199:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496180352:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015221:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.015240:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1790773512.015241:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.015246:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496179200:0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015256:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1790773512.015261:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496179456:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015271:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.015279:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773512.015289:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496179712:0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015292:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496179968:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015309:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.015309:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.015318:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496180480:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015321:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496180224:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015339:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773512.015345:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179328 00000100:00100000:1.0:1790773512.015348:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179328 00000100:00100000:1.0:1790773512.015367:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179584 00000100:00100000:1.0:1790773512.015370:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179584 00000100:00100000:1.0:1790773512.015403:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790773512.015409:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496179328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015453:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179840 00000100:00100000:2.0:1790773512.015458:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179840 00000100:00100000:1.0:1790773512.015459:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496179328:12345-0@lo:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.015465:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790773512.015485:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790773512.015491:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496179584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.015526:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496179584:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.015532:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790773512.015549:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179712 00000100:00100000:1.0:1790773512.015552:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179712 00000100:00100000:2.0:1790773512.015562:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790773512.015567:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496179840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.015605:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496179840:12345-0@lo:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.015640:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773512.015649:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496180608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773512.015685:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180096 00000100:00100000:3.0:1790773512.015692:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180096 00000100:00100000:0.0:1790773512.015696:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773512.015727:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179200 00000100:00100000:0.0:1790773512.015731:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179200 00000100:00100000:0.0:1790773512.015758:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790773512.015764:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3606:x1877761496179200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.015802:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3606:x1877761496179200:12345-0@lo:400:kworker.0 Request processed in 39us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.015809:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1790773512.015855:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773512.015860:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773512.015861:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773512.015892:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496178944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773512.015912:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180352 00000100:00100000:0.0:1790773512.015915:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180352 00000100:00100000:0.0:1790773512.015938:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179456 00000100:00100000:0.0:1790773512.015940:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179456 00000100:00100000:0.0:1790773512.015949:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496179968 00000100:00100000:0.0:1790773512.015951:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496179968 00000100:00100000:0.0:1790773512.015960:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180224 00000100:00100000:0.0:1790773512.015962:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180224 00000100:00100000:0.0:1790773512.015974:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773512.015980:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496180352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016012:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496180352:12345-0@lo:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016018:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790773512.016029:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773512.016035:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d280f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496179456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016062:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d280f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3604:x1877761496179456:12345-0@lo:400:kworker.0 Request processed in 28us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016068:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790773512.016078:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773512.016084:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016120:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3604:x1877761496179968:12345-0@lo:400:kworker.0 Request processed in 35us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016125:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790773512.016137:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790773512.016142:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496180224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016166:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1877761496180224:12345-0@lo:400:kworker.0 Request processed in 25us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016171:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1790773512.016184:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773512.016187:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773512.016231:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773512.016260:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496179840:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016271:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496180352:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016280:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496179328:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016299:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3604:1877761496179456:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016310:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3604:1877761496179968:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016334:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a65cda49-ef94-4b32-a3e4-9e24580a945a:3606:1877761496179200:0@lo:400:kworker.0 00010000:00080000:0.0:1790773512.016347:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14480ea00 x1877761496180224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773512.016357:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3606:1877761496180224:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016367:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496179584:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016391:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180480 00000100:00100000:0.0:1790773512.016401:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180480 00000100:00100000:0.0:1790773512.016428:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790773512.016434:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496180480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016469:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496180480:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016475:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1790773512.016490:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790773512.016506:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d14480c700 x1877761496180480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773512.016515:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496180480:0@lo:400:kworker.0 00000100:00100000:0.0:1790773512.016539:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180608 00000100:00100000:0.0:1790773512.016542:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180608 00000100:00100000:0.0:1790773512.016564:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773512.016570:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496180608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773512.016582:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790773512.016616:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1877761496180608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016622:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790773512.016649:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496180608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773512.016735:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790773512.016746:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496180096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773512.016792:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1877761496180096:12345-0@lo:400:kworker.0 Request processed in 50us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.016861:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3606:1877761496180096:0@lo:400:kworker.0 00000100:00100000:3.0:1790773512.016883:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790773512.020852:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790773512.020880:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496179712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773512.020996:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1877761496179712:12345-0@lo:400:kworker.0 Request processed in 132us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.021005:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790773512.021202:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1444c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3606:1877761496179712:0@lo:400:kworker.0 00000100:00100000:2.0:1790773512.024501:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790773512.644801:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773512.645113:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539776 00000100:00100000:0.0:1790773512.645126:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539776 00000100:00100000:0.0:1790773512.645250:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1790773512.645262:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18112:x1877761484539776:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:0.0:1790773512.645325:0:22685:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773512.645441:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2447df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18112:x1877761484539776:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 181us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.645449:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00080000:2.0:1790773512.645608:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773512.654897:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773512.654989:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484539904 00000100:00100000:3.0:1790773512.654999:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484539904 00000100:00080000:2.0:1790773512.655131:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790773512.655173:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1790773512.655184:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484539904:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:3.0:1790773512.655249:0:22683:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790773512.655341:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484539904:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 158us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773512.655348:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1790773512.663953:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773512.664034:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540032 00000100:00100000:1.0:1790773512.664047:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540032 00000100:00100000:1.0:1790773512.664132:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1790773512.664142:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484540032:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:1.0:1790773512.664180:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790773512.664299:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484540032:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 157us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.664307:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00080000:2.0:1790773512.664376:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773512.670773:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773512.676603:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540160 00000100:00100000:0.0:1790773512.676629:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540160 00000100:00100000:0.0:1790773512.676766:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1790773512.676778:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484540160:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:0.0:1790773512.676850:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00080000:2.0:1790773512.676874:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773512.676966:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18112:x1877761484540160:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 190us (6203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.676974:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1790773512.950382:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773512.950531:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540288 00000100:00100000:1.0:1790773512.950545:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540288 00000100:00100000:1.0:1790773512.950608:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1790773512.950620:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+10:18144:x1877761484540288:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790773512.950666:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773512.950695:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12aa00/0xabf1cc0bc784384c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c1ac expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773512.950731:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12aa00/0xabf1cc0bc784384c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1ac expref: 11 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773512.950746:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12aa00/0xabf1cc0bc784384c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1ac expref: 11 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773512.950755:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12aa00, rc 0) 00000100:00100000:1.0:1790773512.950835:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484540288:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 217us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773512.950843:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1790773512.981868:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773512.982056:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540416 00000100:00100000:0.0:1790773512.982070:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540416 00000100:00100000:0.0:1790773512.982141:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1790773512.982151:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484540416:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790773512.982401:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484540416:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 251us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773512.982409:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:2.0:1790773513.000812:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773513.001067:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540544 00000100:00100000:1.0:1790773513.001079:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540544 00000100:00100000:1.0:1790773513.001144:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:1.0:1790773513.001154:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484540544:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790773513.001686:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484540544:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 530us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773513.001697:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:3.0:1790773513.032802:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.033084:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540672 00000100:00100000:2.0:1790773513.033095:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540672 00000100:00100000:2.0:1790773513.033157:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:2.0:1790773513.033167:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540672:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773513.033574:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540672:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 406us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.033584:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00010000:00010000:3.0:1790773513.039830:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773513.039999:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496180736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790773513.040342:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773513.040415:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180736 00000100:00100000:0.0:1790773513.040422:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180736 00000100:00100000:0.0:1790773513.040473:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773513.040482:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496180736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790773513.040503:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790773513.040545:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496180736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.040552:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790773513.040597:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496180736:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1790773513.050520:0:25007:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a9031e1-1696-4ed7-99a1-a67115ed7fee 00000001:00080000:0.0:1790773513.050538:0:25007:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1790773513.074906:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773513.074980:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540800 00000100:00100000:1.0:1790773513.074991:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540800 00000100:00100000:1.0:1790773513.075049:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:1.0:1790773513.075060:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540800:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790773513.075273:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540800:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 215us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773513.075287:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:1.0:1790773513.085970:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.086408:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484540928 00000100:00100000:2.0:1790773513.086420:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484540928 00000100:00100000:2.0:1790773513.086484:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:2.0:1790773513.086495:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540928:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790773513.086669:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18152:x1877761484540928:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 166us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.086678:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:3.0:1790773513.114937:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773513.115194:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541056 00000100:00100000:0.0:1790773513.115231:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541056 00000100:00100000:0.0:1790773513.115294:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:0.0:1790773513.115305:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18144:x1877761484541056:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790773513.115325:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773513.115346:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e6a00/0xabf1cc0bc7843853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c1dd expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773513.115518:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e6a00/0xabf1cc0bc7843853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1dd expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773513.115530:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e6a00/0xabf1cc0bc7843853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1dd expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773513.115539:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6a00, rc 0) 00000100:00100000:0.0:1790773513.115606:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18144:x1877761484541056:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 302us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.115628:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:0.0:1790773513.120941:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773513.121138:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541184 00000100:00100000:1.0:1790773513.121150:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541184 00000100:00100000:1.0:1790773513.121242:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:1.0:1790773513.121253:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18144:x1877761484541184:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790773513.121284:0:22676:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790773513.121314:0:22676:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790773513.121318:0:22676:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790773513.121321:0:22676:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790773513.121324:0:22676:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790773513.121326:0:22676:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1790773513.123087:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18144:x1877761484541184:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1827us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.123104:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:3.0:1790773513.126132:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.126608:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541312 00000100:00100000:2.0:1790773513.126620:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541312 00000100:00100000:2.0:1790773513.126759:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:2.0:1790773513.126770:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18144:x1877761484541312:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790773513.126787:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773513.126803:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c1e4 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773513.126831:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 13 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773513.126842:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 13 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773513.126851:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ea00, rc 0) 00000100:00100000:2.0:1790773513.126923:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18144:x1877761484541312:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 155us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.126931:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:0.0:1790773513.129737:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.129837:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541440 00000100:00100000:2.0:1790773513.129848:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541440 00000100:00100000:2.0:1790773513.129957:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:2.0:1790773513.129967:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18144:x1877761484541440:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790773513.130142:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18144:x1877761484541440:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 175us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.130171:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:1.0:1790773513.132927:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.133094:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541568 00000100:00100000:2.0:1790773513.133106:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541568 00000100:00100000:2.0:1790773513.133166:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:2.0:1790773513.133178:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18144:x1877761484541568:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790773513.133419:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18144:x1877761484541568:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 242us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.133428:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:2.0:1790773513.139665:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773513.139766:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541696 00000100:00100000:1.0:1790773513.139777:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541696 00000100:00100000:1.0:1790773513.139845:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:1.0:1790773513.139860:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18158:x1877761484541696:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790773513.140056:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1435f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18158:x1877761484541696:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 199us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773513.140065:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:3.0:1790773513.155790:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773513.155969:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541824 00000100:00100000:0.0:1790773513.155980:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541824 00000100:00100000:0.0:1790773513.156042:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:0.0:1790773513.156052:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18158:x1877761484541824:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790773513.156259:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18158:x1877761484541824:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 207us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.156268:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:3.0:1790773513.160739:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773513.160793:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.160931:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484541952 00000100:00100000:2.0:1790773513.160942:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484541952 00000100:00100000:2.0:1790773513.160979:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542208 00000100:00100000:2.0:1790773513.160982:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542208 00000100:00100000:2.0:1790773513.160997:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773513.161004:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484541952:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790773513.161034:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from df26e5e5-3d13-4e64-9b40-d2ff05f45a18@192.168.202.19@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:2.0:1790773513.161072:0:22685:0:(genops.c:1384:class_connect()) connect: client df26e5e5-3d13-4e64-9b40-d2ff05f45a18, cookie 0xabf1cc0bc7843861 00000004:00100000:2.0:1790773513.161104:0:22685:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790773513.164258:0:22685:0:(import.c:65:import_set_state_nolock()) ffff93d27c37a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773513.164393:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2396:x1877761484541952:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 3383us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.164406:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1790773513.164449:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773513.164457:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1877761484542208:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790773513.164485:0:22685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from df26e5e5-3d13-4e64-9b40-d2ff05f45a18@192.168.202.19@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:2.0:1790773513.164538:0:22685:0:(genops.c:1384:class_connect()) connect: client df26e5e5-3d13-4e64-9b40-d2ff05f45a18, cookie 0xabf1cc0bc7843868 00000004:00100000:2.0:1790773513.164564:0:22685:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790773513.164691:0:22685:0:(import.c:65:import_set_state_nolock()) ffff93d272c6b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790773513.164717:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2396:x1877761484542208:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 260us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773513.164724:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1790773513.172059:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.172100:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.172186:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773513.176029:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542464 00000100:00100000:0.0:1790773513.176048:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542464 00000100:00100000:0.0:1790773513.176118:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542336 00000100:00100000:0.0:1790773513.176191:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542336 00000100:00100000:0.0:1790773513.176229:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542080 00000100:00100000:0.0:1790773513.176233:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542080 00000100:00080000:2.0:1790773513.176364:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790773513.176369:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773513.176429:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773513.176441:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+7:18144:x1877761484542464:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773513.176476:0:22684:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773513.176625:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+7:18144:x1877761484542464:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 186us (4577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.176632:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773513.176652:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773513.176670:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:0:x1877761484542336:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773513.176682:0:22684:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790773513.176727:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:0:x1877761484542336:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 58us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.176734:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773513.176747:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1790773513.176754:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:0:x1877761484542080:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790773513.176765:0:22684:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790773513.176786:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:0:x1877761484542080:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 33us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.176792:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1790773513.185646:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773513.185699:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542592 00000100:00100000:1.0:1790773513.185710:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542592 00000100:00100000:1.0:1790773513.185783:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1790773513.185796:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484542592:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790773513.185974:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484542592:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 179us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.185983:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1790773513.197595:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.197635:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773513.197679:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773513.197839:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542720 00000100:00100000:0.0:1790773513.197851:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542720 00000100:00100000:0.0:1790773513.197905:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542848 00000100:00100000:0.0:1790773513.197908:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542848 00000100:00100000:0.0:1790773513.197928:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1790773513.197936:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1877761484542720:12345-192.168.202.19@tcp:8:mount.lustre.0 00000100:00100000:1.0:1790773513.197976:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00010000:00080000:0.0:1790773513.197983:0:24585:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from df26e5e5-3d13-4e64-9b40-d2ff05f45a18@192.168.202.19@tcp t0 exp 0000000000000000 cur 655 last 0 00000100:00100000:1.0:1790773513.197988:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1877761484542848:12345-192.168.202.19@tcp:8:mount.lustre.0 00000020:00000080:0.0:1790773513.198024:0:24585:0:(genops.c:1384:class_connect()) connect: client df26e5e5-3d13-4e64-9b40-d2ff05f45a18, cookie 0xabf1cc0bc784386f 00010000:00080000:1.0:1790773513.198033:0:24190:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from df26e5e5-3d13-4e64-9b40-d2ff05f45a18@192.168.202.19@tcp t0 exp 0000000000000000 cur 655 last 0 00002000:00100000:0.0:1790773513.198040:0:24585:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df26e5e5-3d13-4e64-9b40-d2ff05f45a18/ffff93d1425ac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790773513.198054:0:24585:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:1.0:1790773513.198057:0:24190:0:(genops.c:1384:class_connect()) connect: client df26e5e5-3d13-4e64-9b40-d2ff05f45a18, cookie 0xabf1cc0bc7843876 00002000:00100000:1.0:1790773513.198065:0:24190:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df26e5e5-3d13-4e64-9b40-d2ff05f45a18/ffff93d27fa2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790773513.198074:0:24190:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790773513.198140:0:24585:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1790773513.198143:0:24190:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790773513.198182:0:24190:0:(import.c:65:import_set_state_nolock()) ffff93d27fa2f800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1790773513.198182:0:24585:0:(import.c:65:import_set_state_nolock()) ffff93d1425af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790773513.198310:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484542976 00000100:00100000:3.0:1790773513.198315:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484542976 00000100:00100000:3.0:1790773513.198367:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1790773513.198374:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484542976:12345-192.168.202.19@tcp:900:mount.lustre.0 00000100:00100000:0.0:1790773513.198448:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2396:x1877761484542720:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 511us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773513.198456:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773513.203354:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2396:x1877761484542848:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 5352us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773513.203381:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1790773513.210508:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484542976:12345-192.168.202.19@tcp:900:mount.lustre.0 Request processed in 12120us (12913us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773513.210526:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1790773513.220927:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773513.221041:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543104 00000100:00100000:3.0:1790773513.221052:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543104 00000100:00100000:3.0:1790773513.221113:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1790773513.221123:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484543104:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790773513.221236:0:22686:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790773513.221328:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18144:x1877761484543104:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 206us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773513.221336:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1790773513.370764:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773513.370845:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543232 00000100:00100000:3.0:1790773513.370856:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543232 00000100:00100000:3.0:1790773513.370919:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1790773513.370930:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18181:x1877761484543232:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:3.0:1790773513.370954:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773513.370978:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc784387d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c215 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371052:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371069:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371082:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773513.371137:0:22683:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773513.371139:0:22683:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773513.371155:0:22683:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371175:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc784387d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 8 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371421:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 7 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773513.371428:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:3.0:1790773513.371430:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773513.371433:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3800, rc 0) 00000100:00100000:3.0:1790773513.371530:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+7:18181:x1877761484543232:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 603us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773513.371538:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1790773514.061504:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496180864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790773514.061582:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773514.061759:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180864 00000100:00100000:2.0:1790773514.061768:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180864 00000100:00100000:2.0:1790773514.061820:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1790773514.061823:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773514.061832:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496180864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790773514.061850:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790773514.061862:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496180992:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773514.061868:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790773514.061897:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773514.061925:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496180864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773514.061934:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790773514.061945:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496180864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773514.061952:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496180992 00000100:00100000:2.0:1790773514.061957:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496180992 00000100:00100000:2.0:1790773514.061976:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790773514.061982:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496180992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773514.062013:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790773514.062060:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496180992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773514.062067:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790773514.062402:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496180992:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1790773514.511949:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790773515.086691:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790773516.113545:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790773516.114503:0:24184:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df26e5e5-3d13-4e64-9b40-d2ff05f45a18 00000001:00100000:3.0:1790773516.114515:0:24184:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a9031e1-1696-4ed7-99a1-a67115ed7fee 00000001:00100000:0.0:1790773516.114930:0:23417:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of df26e5e5-3d13-4e64-9b40-d2ff05f45a18 00000001:00100000:0.0:1790773516.114938:0:23417:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8a9031e1-1696-4ed7-99a1-a67115ed7fee 00000001:00100000:0.0:1790773516.115425:0:22663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df26e5e5-3d13-4e64-9b40-d2ff05f45a18 00000001:00100000:0.0:1790773516.115433:0:22663:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a9031e1-1696-4ed7-99a1-a67115ed7fee 00000001:02000400:0.0:1790773516.545707:0:25562:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790773517.133546:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790773517.133580:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496181120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790773517.133666:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.133748:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181120 00000100:00100000:0.0:1790773517.133757:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181120 00000100:00100000:0.0:1790773517.133815:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773517.133825:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496181120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790773517.133861:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790773517.133932:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496181120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.133940:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790773517.134030:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496181120:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1790773517.134271:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790773517.134462:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790773517.134470:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790773517.134482:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496181248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773517.134518:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773517.135259:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773517.135306:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773517.135359:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181248 00000100:00100000:3.0:1790773517.135365:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181248 00000100:00100000:3.0:1790773517.135403:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181376 00000100:00100000:3.0:1790773517.135406:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181376 00000100:00100000:3.0:1790773517.135425:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773517.135433:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496181248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773517.135472:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1790773517.142737:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773517.142750:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773517.147485:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496181504:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.147591:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.147693:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181504 00000100:00100000:0.0:1790773517.147715:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181504 00000100:00100000:0.0:1790773517.147764:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790773517.147774:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3605:x1877761496181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.147829:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d255214850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3605:x1877761496181504:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.147837:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790773517.147887:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a65cda49-ef94-4b32-a3e4-9e24580a945a:3605:1877761496181504:0@lo:400:kworker.0 00000100:00100000:3.0:1790773517.151122:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496181248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15679us (16593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773517.151139:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773517.151175:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790773517.151193:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496181376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773517.151238:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790773517.151308:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496181376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (16001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773517.151314:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790773517.151547:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496181632:0@lo:400:kworker.0 00000100:00100000:2.0:1790773517.151600:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773517.151692:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181632 00000100:00100000:3.0:1790773517.151702:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181632 00000100:00100000:3.0:1790773517.151754:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773517.151761:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.151868:0:3604:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1790773517.151903:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790773517.152221:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496181888:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152254:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152268:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496182400:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152291:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152318:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1790773517.152324:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496182016:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152349:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152368:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496182528:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152389:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152415:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182016 00000100:00100000:0.0:1790773517.152420:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182016 00000100:00100000:0.0:1790773517.152573:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773517.152581:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152635:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496182016:12345-0@lo:400:kworker.0 Request processed in 56us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.152642:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790773517.152680:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182400 00000100:00100000:0.0:1790773517.152684:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182400 00000100:00100000:0.0:1790773517.152709:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182528 00000100:00100000:0.0:1790773517.152712:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182528 00000100:00100000:0.0:1790773517.152726:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790773517.152733:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496182400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152765:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3604:x1877761496182400:12345-0@lo:400:kworker.0 Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.152771:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790773517.152783:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790773517.152788:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496182528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152814:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3604:x1877761496182528:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.152821:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1790773517.152841:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773517.152846:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773517.152848:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790773517.152863:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496181760:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152887:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152905:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496182272:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152923:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152935:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790773517.152940:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496182144:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152959:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.152970:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496182656:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.152989:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773517.153006:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181760 00000100:00100000:0.0:1790773517.153016:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181760 00000100:00100000:0.0:1790773517.153031:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182272 00000100:00100000:0.0:1790773517.153033:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182272 00000100:00100000:0.0:1790773517.153046:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182144 00000100:00100000:0.0:1790773517.153048:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182144 00000100:00100000:0.0:1790773517.153057:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182656 00000100:00100000:0.0:1790773517.153059:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182656 00000100:00100000:0.0:1790773517.153070:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773517.153074:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.153106:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496181760:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.153111:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790773517.153123:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790773517.153128:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.153151:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1877761496182272:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.153155:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790773517.153181:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790773517.153187:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496182144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.159974:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496182144:12345-0@lo:400:kworker.0 Request processed in 6777us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.159990:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790773517.160032:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790773517.160045:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.160106:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1877761496182656:12345-0@lo:400:kworker.0 Request processed in 67us (7115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773517.160113:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790773517.160151:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773517.160157:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773517.160193:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496182016:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.160221:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3604:1877761496182528:0@lo:400:kworker.0 00010000:00080000:0.0:1790773517.160235:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f7100 x1877761496182400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773517.160245:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3604:1877761496182400:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.160281:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496182144:0@lo:400:kworker.0 00010000:00080000:0.0:1790773517.160291:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d27f9f5180 x1877761496182656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790773517.160300:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3607:1877761496182656:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.160309:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496181760:0@lo:400:kworker.0 00000100:00100000:0.0:1790773517.160319:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3607:1877761496182272:0@lo:400:kworker.0 00000100:00100000:2.0:1790773517.160723:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496181248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790773517.160809:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496181632:12345-0@lo:400:kworker.0 Request processed in 9046us (9206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773517.160820:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790773517.160839:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496181888 00000100:00100000:3.0:1790773517.160853:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496181888 00000100:00100000:3.0:1790773517.160881:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790773517.160886:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496181888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773517.160949:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496181888:12345-0@lo:400:kworker.0 Request processed in 62us (8695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773517.160955:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790773517.161233:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496181888:0@lo:400:kworker.0 00000100:00100000:2.0:1790773517.161347:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496181632:0@lo:400:kworker.0 00000100:00100000:2.0:1790773518.157635:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496182784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773518.157733:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773518.157825:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182784 00000100:00100000:3.0:1790773518.157834:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182784 00000100:00100000:3.0:1790773518.157900:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790773518.157911:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496182784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773518.157939:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00010000:00010000:0.0:1790773518.158075:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790773518.164060:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496182784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6140us (6316us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773518.164077:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790773518.169955:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496182784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773518.381336:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381371:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381404:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381426:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381458:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381506:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381530:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381549:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381567:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773518.381597:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543744 00000100:00100000:2.0:1790773518.381625:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543744 00000100:00100000:0.0:1790773518.381772:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543488 00000100:00100000:0.0:1790773518.381777:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543488 00000100:00100000:3.0:1790773518.381836:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544256 00000100:00100000:3.0:1790773518.381841:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544256 00000100:00100000:1.0:1790773518.381899:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544000 00000100:00100000:1.0:1790773518.381903:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544000 00000100:00100000:2.0:1790773518.381970:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543872 00000100:00100000:2.0:1790773518.381974:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543872 00000100:00100000:0.0:1790773518.382441:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543616 00000100:00100000:0.0:1790773518.382446:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543616 00000100:00100000:0.0:1790773518.382463:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544128 00000100:00100000:0.0:1790773518.382467:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544128 00000100:00100000:0.0:1790773518.382486:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1790773518.382496:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2399:x1877761484543488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773518.382575:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2399:x1877761484543488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773518.382592:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1790773518.382631:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1790773518.382638:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773518.382678:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773518.382684:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1790773518.382697:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1790773518.382704:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2399:x1877761484544128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773518.382730:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2399:x1877761484544128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773518.382736:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1790773518.382759:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544384 00000100:00100000:0.0:1790773518.382763:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544384 00000100:00100000:0.0:1790773518.382782:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773518.382789:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773518.382816:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773518.382822:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773518.382833:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1790773518.382839:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2399:x1877761484544384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1790773518.382860:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2399:x1877761484544384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773518.382865:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:0.0:1790773518.382896:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790773518.382901:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790773518.382903:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790773518.382904:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790773518.384337:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1790773518.384351:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2399:x1877761484544256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773518.384410:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2399:x1877761484544256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 64us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773518.384417:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1790773518.384529:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484543360 00000100:00100000:3.0:1790773518.384536:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484543360 00000100:00100000:3.0:1790773518.384560:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:3.0:1790773518.384565:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2399:x1877761484543360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1790773518.384590:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2399:x1877761484543360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773518.384623:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:1.0:1790773518.385869:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773518.385883:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2399:x1877761484544000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773518.385944:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d14480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2399:x1877761484544000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (4539us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773518.385951:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1790773518.387627:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1790773518.387779:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1790773518.387855:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2399:x1877761484543872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 217us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773518.387863:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00010000:00010000:0.0:1790773519.181766:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773519.183828:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496182912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773519.183917:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773519.183982:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496182912 00000100:00100000:2.0:1790773519.183990:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496182912 00000100:00100000:2.0:1790773519.184042:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773519.184050:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496182912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790773519.184087:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790773519.184136:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496182912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.184143:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773519.184189:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496182912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790773519.185922:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496183040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773519.185985:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773519.188574:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183040 00000100:00100000:1.0:1790773519.188590:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183040 00000100:00100000:1.0:1790773519.188707:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790773519.188718:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496183040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1790773519.188759:0:22689:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790773519.188875:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496183040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773519.188882:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790773519.189060:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496183040:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1790773519.195113:0:25007:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df26e5e5-3d13-4e64-9b40-d2ff05f45a18 00000020:00000080:2.0:1790773519.840960:0:25710:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5c119290 20000000:00000080:2.0:1790773519.840982:0:25710:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d27ffc0800 uarg=0000000000000000 20000000:01000000:2.0:1790773519.841026:0:25710:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790773519.841032:0:25710:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790773519.841042:0:25710:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790773519.850511:0:25711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790773519.854553:0:25710:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790773519.865111:0:25710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790773519.865280:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865301:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865310:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 23 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865317:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865324:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865333:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865341:0:25710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 12 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865349:0:25710:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865417:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 12 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865451:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 12 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.865466:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183168:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773519.865565:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865574:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.865583:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183296:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773519.865741:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865750:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.865760:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183424:0@lo:104: 00000100:00100000:3.0:1790773519.865802:0:25710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773519.865847:0:22667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183424 00010000:00010000:3.0:1790773519.865848:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.865855:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 23 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773519.865855:0:22667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183424 00000100:00100000:3.0:1790773519.865862:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183552:0@lo:104: 00000100:00100000:3.0:1790773519.865883:0:25710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773519.868177:0:22667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183552 00000100:00100000:0.0:1790773519.868188:0:22667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183552 00010000:00010000:3.0:1790773519.868233:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 23 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.868248:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 23 pid: 22677 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.868261:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183680:0@lo:104: 00000100:00100000:3.0:1790773519.868304:0:25710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790773519.868328:0:25710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.868336:0:25710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 23 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.868345:0:25710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183808:0@lo:104: 00000100:00100000:3.0:1790773519.868376:0:25710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773519.868388:0:25710:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d255960f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790773519.868408:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183680 00000100:00100000:1.0:1790773519.868415:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183680 00000100:00100000:1.0:1790773519.868449:0:22666:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183808 00000100:00100000:1.0:1790773519.868452:0:22666:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183808 00000100:00100000:1.0:1790773519.868466:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773519.868475:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:25710:x1877761496183424:12345-0@lo:104: 00010000:00010000:1.0:1790773519.868489:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773519.868791:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790773519.868799:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+6:25710:x1877761496183424:12345-0@lo:104: Request processed in 325us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773519.868806:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790773519.868827:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773519.868834:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:25710:x1877761496183680:12345-0@lo:104: 00010000:00010000:1.0:1790773519.868843:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773519.868886:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790773519.868891:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+5:25710:x1877761496183680:12345-0@lo:104: Request processed in 59us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773519.868897:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790773519.868912:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773519.868917:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:25710:x1877761496183808:12345-0@lo:104: 00010000:00010000:1.0:1790773519.868939:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773519.868967:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1790773519.868972:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+4:25710:x1877761496183808:12345-0@lo:104: Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773519.868978:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790773519.868991:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790773519.868997:0:22666:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:25710:x1877761496183552:12345-0@lo:104: 00010000:00010000:1.0:1790773519.869004:0:22666:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773519.869029:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1790773519.869034:0:22666:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a65cda49-ef94-4b32-a3e4-9e24580a945a+3:25710:x1877761496183552:12345-0@lo:104: Request processed in 38us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773519.869039:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1790773519.869089:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790773519.869097:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869105:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773519.869109:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869118:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773519.869126:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773519.869133:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773519.869170:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869178:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773519.869195:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869236:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d27b12b400/0xabf1cc0bc78436af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78436b6 expref: -99 pid: 25006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869247:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790773519.869250:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869276:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7000 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773519.869280:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869287:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773519.869294:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773519.869299:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773519.869315:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869321:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773519.869328:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869334:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7000/0xabf1cc0bc78434ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434f6 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869343:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790773519.869346:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869351:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7400 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773519.869354:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869370:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773519.869377:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773519.869382:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773519.869396:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869402:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773519.869419:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869426:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc78434e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc78434e8 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869435:0:22671:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790773519.869438:0:22671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869444:0:22671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241527200 already unused, calling callback (ffffffffc14cac20) 10000000:00010000:2.0:1790773519.869446:0:22671:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869453:0:22671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790773519.869459:0:22671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790773519.869471:0:22671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790773519.869487:0:22671:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869493:0:22671:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790773519.869499:0:22671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869505:0:22671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffff93d241527200/0xabf1cc0bc784352e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xabf1cc0bc7843535 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869520:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773519.869522:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773519.869524:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773519.869537:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496184064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.869570:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773519.869615:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790773519.869621:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496183936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.869645:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773519.869667:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496184192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.869690:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773519.869705:0:3604:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790773519.869709:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496184320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.869728:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773519.869755:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184064 00000100:00100000:2.0:1790773519.869760:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184064 00010000:00010000:2.0:1790773519.869780:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 24 pid: 22677 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.869801:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496183936 00000100:00100000:2.0:1790773519.869805:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496183936 00010000:00010000:2.0:1790773519.869816:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 25 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.869826:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184192 00000100:00100000:2.0:1790773519.869828:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184192 00010000:00010000:2.0:1790773519.869838:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 26 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.869848:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184320 00000100:00100000:2.0:1790773519.869850:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184320 00010000:00010000:2.0:1790773519.869859:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 27 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.869871:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773519.869877:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+27:3607:x1877761496184064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773519.869887:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773519.869891:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 27 pid: 22677 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869900:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 27 pid: 22677 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869913:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.869942:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+27:3607:x1877761496184064:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.869948:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790773519.869963:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790773519.869976:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+26:3607:x1877761496183936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773519.869983:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773519.869987:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 26 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.869995:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 26 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.870004:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.870026:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+26:3607:x1877761496183936:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.870032:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790773519.870044:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773519.870050:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+25:3604:x1877761496184192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773519.870057:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773519.870061:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 25 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.870069:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 25 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.870078:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.870103:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+25:3604:x1877761496184192:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.870108:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790773519.870119:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773519.870123:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3604:x1877761496184320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790773519.870128:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773519.870135:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 24 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.870141:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 24 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.870147:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.870162:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3604:x1877761496184320:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.870166:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790773519.870190:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496184320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.870195:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a65cda49-ef94-4b32-a3e4-9e24580a945a:3604:1877761496184192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.870232:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496183936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790773519.870236:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496184064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790773519.870535:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790773519.870883:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166f400/0xabf1cc0bc78436b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78436af expref: 23 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.870898:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183424:0@lo:104: 00010000:00010000:3.0:1790773519.870908:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12be00/0xabf1cc0bc7843535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc784352e expref: 22 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.870915:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183552:0@lo:104: 00010000:00010000:3.0:1790773519.870925:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12b600/0xabf1cc0bc78434f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78434ef expref: 21 pid: 22677 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.870932:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183680:0@lo:104: 00010000:00010000:3.0:1790773519.870943:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3e00/0xabf1cc0bc78434e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xabf1cc0bc78434e1 expref: 20 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773519.870948:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773519.870958:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183808:0@lo:104: 00000100:00100000:3.0:1790773519.870971:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144547800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183168:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773519.870979:0:25710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d144546680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25710:1877761496183296:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773519.870985:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:3.0:1790773519.871008:0:25710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.871044:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544512 00000100:00100000:2.0:1790773519.871050:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544512 00010000:00010000:2.0:1790773519.871066:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 13 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773519.871087:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544640 00000100:00100000:2.0:1790773519.871090:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544640 00010000:00010000:2.0:1790773519.871100:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 14 pid: 22676 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773519.871108:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1790773519.871116:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251202c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+14:2398:x1877761484544512:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773519.871126:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773519.871131:0:22720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 14 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.871140:0:22720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 14 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.871152:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d24166ea00/0xabf1cc0bc784385a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1e4 expref: 14 pid: 22678 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773519.871162:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.871191:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1790773519.871225:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251202c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2398:x1877761484544512:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 110us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.871225:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2398:x1877761484544640:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790773519.871232:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:2.0:1790773519.871233:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773519.871243:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871252:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871261:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d27b12ba00/0xabf1cc0bc784381b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c174 expref: 12 pid: 22676 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871287:0:22670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871295:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871309:0:22670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871316:0:22670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871322:0:22670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871328:0:22670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871334:0:22670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773519.871338:0:22670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871345:0:22670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871364:0:22670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.871374:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773519.871398:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:2398:x1877761484544640:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 200us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773519.871405:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:2.0:1790773519.872398:0:25710:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.872411:0:25710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773519.872418:0:25710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d26c4a3000/0xabf1cc0bc784388b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773520.205809:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790773520.269972:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790773521.064015:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.064099:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544768 00000100:00100000:3.0:1790773521.064110:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544768 00000100:00100000:3.0:1790773521.064170:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1790773521.064188:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:18649:x1877761484544768:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773521.064256:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.064285:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2600/0xabf1cc0bc7843892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c21c expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064361:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064378:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064398:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064422:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064429:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064435:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064517:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc78438a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064525:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc78438a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064531:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc78438a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773521.064570:0:22683:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773521.064574:0:22683:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773521.064623:0:22683:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc78438a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064633:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064640:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064647:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064652:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3e00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773521.064655:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064660:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064669:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:3.0:1790773521.064671:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773521.064674:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064678:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc7843899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064686:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064697:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064701:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064704:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773521.064705:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064709:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064712:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93d280936500) 00010000:00010000:3.0:1790773521.064714:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773521.064716:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064719:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc78438a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064742:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2600/0xabf1cc0bc7843892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c21c expref: 8 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064751:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2800/0xabf1cc0bc78438a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c21c expref: 7 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.064755:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936400) 00010000:00010000:3.0:1790773521.064757:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773521.064762:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2800, rc 0) 00000100:00100000:3.0:1790773521.064814:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18649:x1877761484544768:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 629us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.064820:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00080000:0.0:1790773521.065003:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773521.070896:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.071050:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484544896 00000100:00100000:3.0:1790773521.071061:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484544896 00000100:00100000:3.0:1790773521.071119:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1790773521.071130:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18649:x1877761484544896:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1790773521.071634:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18649:x1877761484544896:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 505us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.071644:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773521.073886:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.074022:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545152 00000100:00100000:0.0:1790773521.074033:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545152 00000100:00100000:0.0:1790773521.074126:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1790773521.074237:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18649:x1877761484545152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773521.074259:0:22685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773521.074282:0:22685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7e00/0xabf1cc0bc78438ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c223 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074363:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074379:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074391:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074422:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074430:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074438:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074907:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6600/0xabf1cc0bc78438c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074919:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6600/0xabf1cc0bc78438c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.074927:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6600/0xabf1cc0bc78438c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773521.074937:0:22685:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790773521.075090:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075099:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075106:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075112:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773521.075116:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075225:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075239:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d280936400) 00010000:00010000:0.0:1790773521.075242:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773521.075247:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075253:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7400/0xabf1cc0bc78438b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075268:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075274:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075281:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075286:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773521.075288:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075295:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075302:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d243aca500) 00010000:00010000:0.0:1790773521.075305:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773521.075308:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.075325:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78438bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.076189:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7e00/0xabf1cc0bc78438ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c223 expref: 10 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.076251:0:22685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6600/0xabf1cc0bc78438c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c223 expref: 9 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.076260:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d243aca000) 00010000:00010000:0.0:1790773521.076263:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773521.076266:0:22685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6600, rc 0) 00000100:00100000:0.0:1790773521.076354:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18649:x1877761484545152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2148us (2475us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790773521.076362:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1790773521.080430:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.082650:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545280 00000100:00100000:3.0:1790773521.082666:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545280 00000100:00100000:3.0:1790773521.082745:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1790773521.082756:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18649:x1877761484545280:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1790773521.082891:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18649:x1877761484545280:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 136us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.082899:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1790773521.089713:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.091162:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545408 00000100:00100000:0.0:1790773521.091176:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545408 00000100:00080000:2.0:1790773521.091261:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773521.091282:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1790773521.091295:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:18649:x1877761484545408:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1790773521.092918:0:22685:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1570us 00000100:00100000:1.0:1790773521.117854:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.117981:0:22684:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1790773521.117993:0:22684:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790773521.118692:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545536 00000100:00100000:1.0:1790773521.118703:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545536 00000100:00100000:2.0:1790773521.118955:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773521.118968:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18655:x1877761484545536:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773521.118990:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.119014:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c22a expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119091:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119105:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119117:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119132:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119139:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119146:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119351:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119359:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119366:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119373:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fe00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.119377:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119395:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119409:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:2.0:1790773521.119412:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.119418:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119424:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc78438d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119436:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119442:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119459:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119465:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.119468:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119475:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119483:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:2.0:1790773521.119486:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.119489:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119507:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119542:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c22a expref: 10 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119552:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:2.0:1790773521.119554:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.119558:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c22a expref: 10 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.119567:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fc00, rc 0) 00000100:00100000:2.0:1790773521.119687:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18655:x1877761484545536:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 722us (1846us total) trans 0 rc 301/301 00000100:00100000:2.0:1790773521.119695:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773521.127844:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:18649:x1877761484545408:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 36544us (38132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.127859:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1790773521.141013:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.141132:0:22692:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545664 00000100:00100000:2.0:1790773521.141143:0:22692:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545664 00000100:00100000:2.0:1790773521.141201:0:22692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1790773521.141242:0:22692:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18655:x1877761484545664:12345-192.168.202.19@tcp:700:lfs.0 00000100:00100000:2.0:1790773521.141341:0:22692:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18655:x1877761484545664:12345-192.168.202.19@tcp:700:lfs.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.141348:0:22692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773521.144606:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.144683:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484545920 00000100:00100000:1.0:1790773521.144694:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484545920 00000100:00100000:1.0:1790773521.144754:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1790773521.144766:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:18655:x1877761484545920:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:1.0:1790773521.144832:0:22684:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773521.144876:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b800/0xabf1cc0bc7843845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c1a5 expref: 9 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.144897:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:1.0:1790773521.144902:0:22684:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790773521.144969:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.144986:0:22684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 5 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.144996:0:22684:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.145104:0:22684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 5 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.145121:0:22684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 5 pid: 22683 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.145136:0:22684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22684:1877761496184448:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773521.153390:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.153526:0:22669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546048 00000100:00100000:3.0:1790773521.153537:0:22669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546048 00010000:00010000:3.0:1790773521.153609:0:22669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 6/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 6 pid: 22683 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.153649:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1790773521.153660:0:22669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2398:x1877761484546048:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773521.153688:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773521.153696:0:22669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 6/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 6 pid: 22683 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.153709:0:22669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 6 pid: 22683 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.153732:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:3.0:1790773521.153738:0:22669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.153749:0:22669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.153757:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.153775:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773521.153827:0:22669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2398:x1877761484546048:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 168us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.153834:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:1.0:1790773521.154031:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790773521.154146:0:22684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b900 going to sleep for 11 seconds 00010000:00010000:2.0:1790773521.154178:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843884 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c215 expref: 5 pid: 22683 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.154195:0:22684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22684:1877761496184448:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773521.154241:0:22684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.154251:0:22684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.154258:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.154285:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.154295:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.154302:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156264:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156344:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156355:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773521.156375:0:22684:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9a2407c reply state 000000005ee48867 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156394:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156401:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773521.156405:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773521.156409:0:22684:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790773521.156415:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773521.156423:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156431:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156438:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156443:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.156447:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156457:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156466:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d14363c900) 00010000:00010000:2.0:1790773521.156469:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.156472:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156477:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc78438e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773521.156505:0:22684:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9a2407c reply state 000000005ee48867 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156513:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.156519:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:2.0:1790773521.156521:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790773521.156523:0:22684:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790773521.156723:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+10:18655:x1877761484545920:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 11956us (12124us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1790773521.156731:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1790773521.198645:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.199177:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546176 00000100:00100000:0.0:1790773521.199189:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546176 00000100:00100000:1.0:1790773521.199454:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:1.0:1790773521.199469:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+11:18027:x1877761484546176:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790773521.199488:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790773521.199512:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78438fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c231 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.199562:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78438fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c231 expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.199576:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d27b12b800/0xabf1cc0bc78438fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c231 expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.199599:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d27b12b800, rc 0) 00000100:00100000:1.0:1790773521.199675:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546176:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 209us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.199691:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:0.0:1790773521.214769:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.214859:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546304 00000100:00100000:3.0:1790773521.214870:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546304 00000100:00100000:3.0:1790773521.214935:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:3.0:1790773521.214946:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546304:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.215166:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546304:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 221us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.215174:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00010000:00010000:0.0:1790773521.230397:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773521.235818:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.236011:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546432 00000100:00100000:1.0:1790773521.236023:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546432 00000100:00100000:1.0:1790773521.236127:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:1.0:1790773521.236138:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546432:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.236330:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546432:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 185us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.236338:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:1.0:1790773521.240023:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.240232:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546560 00000100:00100000:3.0:1790773521.240243:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546560 00000100:00100000:3.0:1790773521.240323:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:3.0:1790773521.240488:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+12:18027:x1877761484546560:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773521.240512:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.240530:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc7843902 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c238 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.240837:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc7843902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c238 expref: 13 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.240852:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26c4a2600/0xabf1cc0bc7843902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c238 expref: 13 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.240866:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2600, rc 0) 00000100:00100000:3.0:1790773521.241064:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18027:x1877761484546560:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 580us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.241071:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:0.0:1790773521.244989:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.245083:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546688 00000100:00100000:1.0:1790773521.245093:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546688 00000100:00100000:1.0:1790773521.245149:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:1.0:1790773521.245159:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18027:x1877761484546688:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.245712:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18027:x1877761484546688:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 552us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.245723:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:0.0:1790773521.247567:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.247660:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546816 00000100:00100000:3.0:1790773521.247669:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546816 00000100:00100000:3.0:1790773521.247761:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:3.0:1790773521.247770:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18027:x1877761484546816:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.247912:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:18027:x1877761484546816:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 143us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.247921:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:0.0:1790773521.258018:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.260247:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484546944 00000100:00100000:2.0:1790773521.260265:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484546944 00000100:00100000:2.0:1790773521.260355:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1790773521.260366:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+10:18663:x1877761484546944:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:2.0:1790773521.260395:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.260432:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c23f expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260501:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260517:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260527:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.260602:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790773521.260607:0:25725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773521.260651:0:25725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260688:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c23f expref: 12 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260710:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ee00/0xabf1cc0bc7843910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c23f expref: 11 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.260720:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:2.0:1790773521.260723:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773521.260726:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ee00, rc 0) 00000100:00100000:2.0:1790773521.260802:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+11:18663:x1877761484546944:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 437us (2793us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.260810:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000040:00080000:3.0:1790773521.293753:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790773521.307538:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.307739:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484547072 00000100:00100000:3.0:1790773521.307762:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484547072 00000100:00100000:3.0:1790773521.307876:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1790773521.307887:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:18666:x1877761484547072:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773521.307908:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.308157:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c246 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308405:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc784391e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308419:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc784391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308430:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc784391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773521.308474:0:22683:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773521.308478:0:22683:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773521.308502:0:22683:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc784391e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308526:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c246 expref: 7 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308544:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3e00/0xabf1cc0bc784391e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c246 expref: 6 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.308552:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:3.0:1790773521.308555:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773521.308559:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3e00, rc 0) 00000100:00100000:3.0:1790773521.308736:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18666:x1877761484547072:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 851us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.308744:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1790773521.311792:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.312109:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484547200 00000100:00100000:2.0:1790773521.312120:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484547200 00000100:00100000:2.0:1790773521.312517:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1790773521.312529:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:18666:x1877761484547200:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773521.312552:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.312588:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c24d expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312657:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312687:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312696:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312708:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312715:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312721:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312795:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312813:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312820:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.312860:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790773521.312864:0:25725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773521.312884:0:25725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312896:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312912:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312919:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312925:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.312930:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312938:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312949:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:2.0:1790773521.312964:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.312969:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312975:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784392c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312989:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.312995:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313000:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313005:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.313022:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313029:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313036:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:2.0:1790773521.313038:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.313041:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313046:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc7843933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313069:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c24d expref: 8 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313082:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c24d expref: 7 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.313089:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773521.313091:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790773521.313093:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ea00, rc 0) 00000100:00100000:2.0:1790773521.313153:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+7:18666:x1877761484547200:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 627us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.313161:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:0.0:1790773521.317511:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.317671:0:22695:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484547328 00000100:00100000:3.0:1790773521.317681:0:22695:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484547328 00000100:00100000:3.0:1790773521.317750:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1790773521.317761:0:22695:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:18666:x1877761484547328:12345-192.168.202.19@tcp:900:lfs.0 00000100:00100000:3.0:1790773521.317943:0:22695:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:18666:x1877761484547328:12345-192.168.202.19@tcp:900:lfs.0 Request processed in 183us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.318073:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00080000:1.0:1790773521.318654:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773521.325576:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.325670:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484547584 00000100:00100000:2.0:1790773521.325681:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484547584 00000100:00100000:2.0:1790773521.325752:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1790773521.325763:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+7:18666:x1877761484547584:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773521.325811:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.325833:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c254 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.325942:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773521.326062:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843941 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c254 expref: 9 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.326078:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:2.0:1790773521.326082:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773521.326087:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c254 expref: 9 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.326100:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fe00, rc 0) 00000100:00100000:2.0:1790773521.326153:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+8:18666:x1877761484547584:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 392us (587us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1790773521.326161:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1790773521.329377:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.329589:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484547840 00000100:00100000:2.0:1790773521.329599:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484547840 00000100:00100000:2.0:1790773521.329686:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1790773521.329701:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+8:18666:x1877761484547840:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:2.0:1790773521.329752:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773521.329777:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc784393a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c24d expref: 8 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.329795:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773521.329809:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773521.329847:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.329867:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.329874:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790773521.330052:0:22685:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a2c4c95b reply state 00000000648c7eeb transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.330065:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.330072:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773521.330074:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790773521.330077:0:22685:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790773521.330084:0:22685:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1790773521.330160:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+9:18666:x1877761484547840:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 460us (793us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1790773521.330165:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1790773521.334094:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.334195:0:22687:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548096 00000100:00100000:1.0:1790773521.334221:0:22687:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548096 00000100:00100000:1.0:1790773521.334351:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1790773521.334362:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+9:18666:x1877761484548096:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1790773521.334610:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+10:18666:x1877761484548096:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 250us (524us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1790773521.334619:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1790773521.337146:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.337194:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548352 00000100:00100000:2.0:1790773521.337233:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548352 00000100:00100000:2.0:1790773521.337563:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1790773521.337574:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+10:18666:x1877761484548352:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773521.337612:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.337631:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c25b expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337705:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337744:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337757:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337769:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337777:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337783:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.337877:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790773521.337971:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337982:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337988:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.337995:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.337999:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338006:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338038:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:2.0:1790773521.338041:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.338046:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338053:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc784395d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338076:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338083:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338088:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338092:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773521.338095:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338100:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338107:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:2.0:1790773521.338109:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773521.338112:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338117:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338157:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843956 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c25b expref: 12 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338175:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:2.0:1790773521.338179:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773521.338183:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c25b expref: 12 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.338192:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fe00, rc 0) 00000100:00100000:2.0:1790773521.338856:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+11:18666:x1877761484548352:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1282us (1717us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1790773521.338865:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:0.0:1790773521.350934:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.351252:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548480 00000100:00100000:3.0:1790773521.351265:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548480 00000100:00100000:3.0:1790773521.351333:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1790773521.351345:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+11:18666:x1877761484548480:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773521.351373:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.351394:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843972 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c262 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351485:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351501:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351512:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773521.351537:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773521.351553:0:25725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773521.351576:0:25725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351625:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843972 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 13 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351643:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 12 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.351653:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:3.0:1790773521.351655:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790773521.351659:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3600, rc 0) 00000100:00100000:3.0:1790773521.351725:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+12:18666:x1877761484548480:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 382us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.351733:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1790773521.355716:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.355845:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548608 00000100:00100000:3.0:1790773521.355858:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548608 00000100:00100000:3.0:1790773521.355913:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1790773521.355922:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+12:18666:x1877761484548608:12345-192.168.202.19@tcp:37:lfs.0 00000100:00100000:2.0:1790773521.360831:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+12:18666:x1877761484548608:12345-192.168.202.19@tcp:37:lfs.0 Request processed in 4900us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.360845:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1790773521.366429:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.366497:0:22687:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548864 00000100:00100000:1.0:1790773521.366508:0:22687:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548864 00000100:00100000:1.0:1790773521.366566:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1790773521.366574:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+12:18666:x1877761484548864:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1790773521.366825:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143065850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+13:18666:x1877761484548864:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 251us (403us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1790773521.366833:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1790773521.418177:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.418303:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484548992 00000100:00100000:3.0:1790773521.418313:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484548992 00000100:00100000:3.0:1790773521.418374:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:3.0:1790773521.418384:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+11:18672:x1877761484548992:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1790773521.418403:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.418420:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c269 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418488:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418501:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418510:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418516:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418521:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418525:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418628:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2200/0xabf1cc0bc7843995 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418636:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2200/0xabf1cc0bc7843995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418642:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2200/0xabf1cc0bc7843995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773521.418675:0:22683:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790773521.418679:0:22683:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773521.418718:0:22683:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2200/0xabf1cc0bc7843995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418735:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418739:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418744:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418747:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773521.418750:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418755:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418763:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:3.0:1790773521.418765:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773521.418768:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418773:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418781:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418785:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418788:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418794:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a2a00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773521.418796:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418799:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418803:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:3.0:1790773521.418805:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773521.418806:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418809:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc784398e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418827:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3000/0xabf1cc0bc7843980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c269 expref: 13 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418834:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2200/0xabf1cc0bc7843995 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c269 expref: 12 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.418838:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:3.0:1790773521.418839:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790773521.418841:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2200, rc 0) 00000100:00100000:3.0:1790773521.418889:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+12:18672:x1877761484548992:12345-192.168.202.19@tcp:101:bash.0 Request processed in 508us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.418894:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1790773521.421920:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.422002:0:22694:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484549120 00000100:00100000:3.0:1790773521.422024:0:22694:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484549120 00000100:00100000:3.0:1790773521.422079:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1790773521.422097:0:22694:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:18672:x1877761484549120:12345-192.168.202.19@tcp:900:bash.0 00000100:00100000:3.0:1790773521.422176:0:22694:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:18672:x1877761484549120:12345-192.168.202.19@tcp:900:bash.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.422182:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773521.428605:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.428702:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484549376 00000100:00100000:2.0:1790773521.428711:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484549376 00000100:00100000:2.0:1790773521.428759:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1790773521.428766:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+12:18672:x1877761484549376:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773521.428784:0:22685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.428801:0:22685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc784399c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c270 expref: -99 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.428885:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.428912:0:22685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 12 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.428918:0:22685:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.428943:0:22685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 12 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.428953:0:22685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 12 pid: 25725 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.428963:0:22685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22685:1877761496184576:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773521.429031:0:22685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6da300 going to sleep for 11 seconds 00000100:00100000:2.0:1790773521.436501:0:22685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22685:1877761496184576:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773521.436528:0:22685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773521.439497:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.439903:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484549504 00000100:00100000:3.0:1790773521.439914:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484549504 00010000:00010000:3.0:1790773521.439958:0:22720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 13 pid: 25725 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.440007:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1790773521.440018:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+13:2398:x1877761484549504:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773521.440037:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773521.440044:0:22720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 13 pid: 25725 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440059:0:22720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 13 pid: 25725 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440083:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843979 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c262 expref: 13 pid: 25725 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440101:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:3.0:1790773521.440106:0:22720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440117:0:22720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440141:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.440177:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773521.440295:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+12:2398:x1877761484549504:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 278us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.440302:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00010000:00010000:0.0:1790773521.441071:0:22685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441081:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441108:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441119:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441128:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441864:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441876:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441884:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790773521.441908:0:22685:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790773521.441934:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441941:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441948:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441954:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773521.441959:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441966:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441978:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:0.0:1790773521.441981:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790773521.441984:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.441990:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc78439a3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790773521.442002:0:22685:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089be6d30 reply state 00000000408d164c transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.442012:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.442029:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93d243aca500) 00010000:00010000:0.0:1790773521.442032:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773521.442035:0:22685:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790773521.442073:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc784399c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 15 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.442089:0:22685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 14 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.442095:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:0.0:1790773521.442098:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1790773521.442099:0:22685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7c00, rc 0) 00000100:00100000:0.0:1790773521.442902:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1444c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+15:18672:x1877761484549376:12345-192.168.202.19@tcp:101:bash.0 Request processed in 14130us (14301us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1790773521.442912:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1790773521.459190:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.460419:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484549632 00000100:00100000:2.0:1790773521.460432:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484549632 00000100:00100000:2.0:1790773521.460497:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1790773521.460505:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+15:18672:x1877761484549632:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1790773521.460528:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.460544:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc78439bf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c277 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460642:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460654:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460662:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.460701:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790773521.460704:0:22684:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773521.460725:0:22684:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460736:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460761:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc78439bf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 17 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460780:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 16 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.460789:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773521.460792:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773521.460795:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ea00, rc 0) 00000100:00100000:2.0:1790773521.460924:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+16:18672:x1877761484549632:12345-192.168.202.19@tcp:101:bash.0 Request processed in 419us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.460929:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1790773521.472659:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.472989:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484549888 00000100:00100000:2.0:1790773521.472998:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484549888 00000100:00100000:2.0:1790773521.473046:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1790773521.473053:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+16:18672:x1877761484549888:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1790773521.473627:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+17:18672:x1877761484549888:12345-192.168.202.19@tcp:35:bash.0 Request processed in 571us (971us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1790773521.473636:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1790773521.551243:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.551566:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484550144 00000100:00100000:3.0:1790773521.551583:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484550144 00000100:00100000:3.0:1790773521.551895:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1790773521.551906:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+17:18682:x1877761484550144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1790773521.551928:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.551955:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78439cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c27e expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773521.552043:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1790773521.552126:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78439cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c27e expref: 19 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.552137:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d26ff75800) 00010000:00010000:3.0:1790773521.552139:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790773521.552143:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc78439cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c27e expref: 19 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.552153:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3600, rc 0) 00000100:00100000:3.0:1790773521.552257:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+18:18682:x1877761484550144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 351us (1061us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1790773521.552405:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1790773521.555134:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.555416:0:22687:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484550400 00000100:00100000:1.0:1790773521.555426:0:22687:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484550400 00000100:00100000:1.0:1790773521.555506:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773521.555514:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+18:18682:x1877761484550400:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1790773521.555883:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+19:18682:x1877761484550400:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 368us (753us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1790773521.555892:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1790773521.576558:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.577638:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484550656 00000100:00100000:2.0:1790773521.577652:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484550656 00000100:00100000:2.0:1790773521.577719:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1790773521.577729:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+19:18685:x1877761484550656:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1790773521.577756:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.577780:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc78439db lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c285 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.577877:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc78439e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.577889:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc78439e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.577898:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc78439e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.577907:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773521.578013:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e600/0xabf1cc0bc78439db lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c285 expref: 22 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.578033:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc78439e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c285 expref: 21 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.578055:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773521.578058:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773521.578061:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166e400, rc 0) 00000100:00100000:2.0:1790773521.578133:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18685:x1877761484550656:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 405us (1582us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1790773521.578139:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:3.0:1790773521.582797:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.582858:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484550784 00000100:00100000:0.0:1790773521.582868:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484550784 00000100:00100000:0.0:1790773521.582928:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1790773521.582938:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18685:x1877761484550784:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1790773521.583006:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583025:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583037:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583090:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583097:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583103:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583109:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e7000 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773521.583113:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583120:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583132:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:0.0:1790773521.583135:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790773521.583140:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.583146:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7000/0xabf1cc0bc78439f0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773521.583704:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18685:x1877761484550784:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 765us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.583714:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:1.0:1790773521.591782:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.591834:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.591835:0:22669:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484550912 00000100:00100000:3.0:1790773521.591845:0:22669:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484550912 00000100:00100000:3.0:1790773521.591911:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1790773521.591922:0:22669:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:2398:x1877761484550912:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773521.591938:0:22669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773521.591961:0:22669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc78439e2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c285 expref: 21 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.591980:0:22669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773521.591985:0:22669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773521.592032:0:22669:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+20:2398:x1877761484550912:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.592038:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1790773521.596968:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484551168 00000100:00100000:0.0:1790773521.596983:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484551168 00000100:00100000:0.0:1790773521.597039:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1790773521.597059:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+20:18685:x1877761484551168:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1790773521.598559:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18685:x1877761484551168:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 1489us (6713us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1790773521.598572:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000040:00080000:0.0:1790773521.684166:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1790773521.805428:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773521.805436:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d281bb3000 from 13 10000000:01000000:1.0:1790773521.805441:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773521.805491:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.805504:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.805516:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.805542:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.805628:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773521.805677:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265b300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.805829:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184704 00000100:00100000:0.0:1790773521.805838:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184704 00000100:00100000:0.0:1790773521.805905:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790773521.805916:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+20:22680:x1877761496184704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773521.805930:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773521.805944:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e7000/0xabf1cc0bc78439fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc78439f7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.805968:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e7000/0xabf1cc0bc78439fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc78439f7 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.805977:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e7000/0xabf1cc0bc78439fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc78439f7 expref: 21 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.805987:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7000, rc 0) 00000100:00100000:0.0:1790773521.806044:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496184704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.806052:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790773521.806249:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773521.806267:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78439fe expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.806277:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc78439fe expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.806338:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.806368:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.806751:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250e4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.817684:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184832 00000100:00100000:0.0:1790773521.817701:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184832 00000100:00100000:0.0:1790773521.817777:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790773521.817787:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496184832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.818023:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496184832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (11654us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.818031:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790773521.818105:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.818160:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.818241:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.818280:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d250e4b180 going to sleep for 11 seconds 00000100:00100000:1.0:1790773521.818341:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496184960 00000100:00100000:1.0:1790773521.818346:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496184960 00000100:00100000:1.0:1790773521.818392:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790773521.818400:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496184960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.818501:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496184960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.818508:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790773521.818762:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496184960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773521.826259:0:25726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790773521.831617:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790773521.831663:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790773521.831676:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78439fe expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.831688:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12a400/0xabf1cc0bc78439f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc78439fe expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790773521.831699:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790773521.831706:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d26ec3d800 from 13 10000000:01000000:1.0:1790773521.831709:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790773521.831749:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.831756:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.831767:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.832557:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.832648:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790773521.832696:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d14265ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.832933:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185088 00000100:00100000:0.0:1790773521.832943:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185088 00000100:00100000:0.0:1790773521.832997:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790773521.833007:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+21:22680:x1877761496185088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773521.833023:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773521.833040:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e7e00/0xabf1cc0bc7843a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843a05 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.833064:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e7e00/0xabf1cc0bc7843a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a05 expref: 22 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.833075:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e7e00/0xabf1cc0bc7843a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a05 expref: 22 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.833083:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e7e00, rc 0) 00000100:00100000:0.0:1790773521.833158:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.833164:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790773521.833331:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27f9f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773521.833349:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a0c expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.833359:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843a0c expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.833435:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.833473:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.833504:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2511636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.833678:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185216 00000100:00100000:0.0:1790773521.833683:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185216 00000100:00100000:0.0:1790773521.833717:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790773521.833723:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.833839:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.833864:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790773521.834032:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.834062:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.834103:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.834125:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d2511636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790773521.834176:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185344 00000100:00100000:1.0:1790773521.834180:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185344 00000100:00100000:1.0:1790773521.834248:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790773521.834256:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.834333:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.834340:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790773521.834444:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790773521.835504:0:25727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790773521.835926:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790773521.835951:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773521.835962:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a0c expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.835989:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d27b12ba00/0xabf1cc0bc7843a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a0c expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790773521.836000:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790773521.836003:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d14482b000 from 13 10000000:01000000:3.0:1790773521.836006:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790773521.836041:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.836048:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.836059:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.836084:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.836146:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.836180:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163180 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.836256:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185472 00000100:00100000:0.0:1790773521.836264:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185472 00000100:00100000:0.0:1790773521.836307:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790773521.836316:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+22:22680:x1877761496185472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773521.836330:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773521.836343:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d26b5e6800/0xabf1cc0bc7843a1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843a13 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.836363:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d26b5e6800/0xabf1cc0bc7843a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a13 expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.836373:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d26b5e6800/0xabf1cc0bc7843a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a13 expref: 23 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.836391:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26b5e6800, rc 0) 00000100:00100000:0.0:1790773521.836428:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27ffccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773521.836433:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790773521.836741:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790773521.836755:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a1a expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.836763:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843a1a expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773521.836823:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.836852:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.836891:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163180 going to sleep for 11 seconds 00000100:00100000:1.0:1790773521.836934:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185600 00000100:00100000:1.0:1790773521.836939:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185600 00000100:00100000:1.0:1790773521.836971:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1790773521.836978:0:22678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.837101:0:22678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.837109:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790773521.837358:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.837401:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790773521.837441:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773521.837467:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163180 going to sleep for 11 seconds 00000100:00100000:1.0:1790773521.837615:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185728 00000100:00100000:1.0:1790773521.837620:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185728 00000100:00100000:1.0:1790773521.837642:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790773521.837647:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.837728:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.837734:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790773521.837895:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790773521.839198:0:25728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1790773521.843271:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1790773521.843295:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790773521.843306:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a1a expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.843318:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26c4a3000/0xabf1cc0bc7843a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a1a expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790773521.843330:0:22680:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790773521.843348:0:22680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d24f7ba800 from 13 10000000:01000000:0.0:1790773521.843351:0:22680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790773521.843651:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.843661:0:22680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.843672:0:22680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773521.843697:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.843763:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773521.843904:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773521.844073:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185856 00000100:00100000:3.0:1790773521.844082:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185856 00000100:00100000:2.0:1790773521.844235:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790773521.844245:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+23:22680:x1877761496185856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790773521.844259:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.844272:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d24166e600/0xabf1cc0bc7843a28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xabf1cc0bc7843a21 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.844295:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d24166e600/0xabf1cc0bc7843a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a21 expref: 24 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.844306:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d24166e600/0xabf1cc0bc7843a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xabf1cc0bc7843a21 expref: 24 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.844315:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166e600, rc 0) 00000100:00100000:2.0:1790773521.844366:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c397c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496185856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773521.844373:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790773521.844454:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790773521.844469:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a28 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.844478:0:22680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xabf1cc0bc7843a28 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773521.844546:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.844585:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773521.844836:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773521.844957:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496185984 00000100:00100000:1.0:1790773521.844962:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496185984 00000100:00100000:1.0:1790773521.844986:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790773521.844993:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496185984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.845159:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496185984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.845167:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790773521.845321:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496185984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.845353:0:22680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496186112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790773521.845470:0:22680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773521.845548:0:22680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:3.0:1790773521.845654:0:22678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496186112 00000100:00100000:3.0:1790773521.845659:0:22678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496186112 00000100:00100000:1.0:1790773521.845869:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790773521.845877:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496186112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790773521.845993:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:22680:x1877761496186112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.846000:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1790773521.846098:0:22680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a65cda49-ef94-4b32-a3e4-9e24580a945a:22680:1877761496186112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790773521.850648:0:25729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790773521.857050:0:22680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790773521.857093:0:22680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790773521.857106:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a28 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.857119:0:22680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffff93d26b5e7400/0xabf1cc0bc7843a21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xabf1cc0bc7843a28 expref: -99 pid: 22680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.903755:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.903974:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484551424 00000100:00100000:2.0:1790773521.903985:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484551424 00000100:00100000:2.0:1790773521.904046:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1790773521.904066:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18716:x1877761484551424:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1790773521.904093:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.904115:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c28c expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.904276:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a36 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.904290:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.904302:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.904314:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773521.904658:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c28c expref: 24 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.904677:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c28c expref: 23 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.904686:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773521.904689:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790773521.904693:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166f400, rc 0) 00000100:00100000:2.0:1790773521.904760:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:18716:x1877761484551424:12345-192.168.202.19@tcp:101:cat.0 Request processed in 695us (1015us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1790773521.904767:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:3.0:1790773521.910817:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.910869:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.910974:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484551680 00000100:00100000:0.0:1790773521.910987:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484551680 00000100:00100000:0.0:1790773521.911049:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1790773521.911059:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:18716:x1877761484551680:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1790773521.911407:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+24:18716:x1877761484551680:12345-192.168.202.19@tcp:35:cat.0 Request processed in 347us (600us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1790773521.911417:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1790773521.914136:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484551808 00000100:00100000:1.0:1790773521.914151:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484551808 00000100:00100000:1.0:1790773521.914247:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1790773521.914257:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+24:2397:x1877761484551808:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773521.914276:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773521.914299:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a36 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c28c expref: 24 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.914319:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:1.0:1790773521.914325:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773521.914378:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:2397:x1877761484551808:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 122us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.914385:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1790773521.968375:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773521.968621:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552064 00000100:00100000:2.0:1790773521.968633:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552064 00000100:00100000:2.0:1790773521.968712:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1790773521.968721:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:18722:x1877761484552064:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:2.0:1790773521.968744:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773521.968765:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a44 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c293 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968876:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968892:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 24 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968901:0:25725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 24 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968910:0:25725:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968945:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 24 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.968959:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 24 pid: 22684 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.968972:0:25725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25725:1877761496186240:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773521.969081:0:25725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 24 pid: 22685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.969101:0:25725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 24 pid: 22685 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.969111:0:25725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25725:1877761496186368:192.168.202.19@tcp:104: 00000100:00100000:2.0:1790773521.969137:0:25725:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d26c6da300 going to sleep for 11 seconds 00000100:00100000:0.0:1790773521.972043:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.972084:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773521.972178:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552192 00000100:00100000:1.0:1790773521.972187:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552192 00010000:00010000:1.0:1790773521.972265:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 25 pid: 22684 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.972308:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552320 00000100:00100000:1.0:1790773521.972311:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552320 00010000:00010000:1.0:1790773521.972323:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 26 pid: 22685 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773521.972342:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773521.972351:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+26:2398:x1877761484552192:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773521.972365:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773521.972384:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 26 pid: 22684 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972397:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 26 pid: 22684 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972420:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:1.0:1790773521.972424:0:22668:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972434:0:22668:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972441:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773521.972498:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+26:2398:x1877761484552192:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 148us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.972506:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773521.972523:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773521.972529:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d251203c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+25:2398:x1877761484552320:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790773521.972537:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790773521.972541:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 25 pid: 22685 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972550:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 25 pid: 22685 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972561:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:1.0:1790773521.972565:0:22668:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972589:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972595:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773521.972623:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790773521.972643:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d251203c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+25:2398:x1877761484552320:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 114us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773521.972650:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:2.0:1790773521.973648:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc78439c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c277 expref: 24 pid: 22684 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.973671:0:25725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25725:1877761496186240:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773521.973684:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc78439b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c270 expref: 23 pid: 22685 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773521.973696:0:25725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25725:1877761496186368:192.168.202.19@tcp:104: 00010000:00010000:2.0:1790773521.973719:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.973728:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.973735:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773521.973759:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773521.973934:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a44 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c293 expref: 24 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.973966:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fe00/0xabf1cc0bc7843a4b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c293 expref: 23 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773521.973975:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773521.973977:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790773521.973980:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166fe00, rc 0) 00000100:00100000:2.0:1790773521.974033:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:18722:x1877761484552064:12345-192.168.202.19@tcp:101:dd.0 Request processed in 5313us (5667us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1790773521.974042:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1790773521.976939:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.977036:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552448 00000100:00100000:3.0:1790773521.977047:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552448 00000100:00100000:3.0:1790773521.977109:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1790773521.977119:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+23:18722:x1877761484552448:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1790773521.977144:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.977165:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a59 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c29a expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977240:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977255:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977277:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977382:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a59 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 25 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977399:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 24 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.977408:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773521.977411:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790773521.977415:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3600, rc 0) 00000100:00100000:3.0:1790773521.977489:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+24:18722:x1877761484552448:12345-192.168.202.19@tcp:101:dd.0 Request processed in 372us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.977497:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1790773521.980724:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773521.981130:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552704 00000100:00100000:0.0:1790773521.981140:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552704 00000100:00100000:0.0:1790773521.981279:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1790773521.981290:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+24:18722:x1877761484552704:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:0.0:1790773521.981499:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.981516:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.981527:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790773521.981562:0:22685:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1790773521.981593:0:22685:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d7a68813 reply state 00000000712cb2d0 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.981635:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773521.981643:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:0.0:1790773521.981645:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790773521.981649:0:22685:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773521.981753:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484552704:12345-192.168.202.19@tcp:36:dd.0 Request processed in 464us (1036us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1790773521.981761:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000020:00080000:0.0:1790773521.981766:0:22685:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790773521.983873:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773521.983949:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484552832 00000100:00100000:3.0:1790773521.983959:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484552832 00000100:00100000:3.0:1790773521.984014:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:3.0:1790773521.984023:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484552832:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1790773521.984047:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773521.984079:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a6e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2a1 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.984134:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a6e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a1 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.984147:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a6e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a1 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773521.984165:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773521.984168:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773521.984172:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a3400, rc 0) 00000100:00100000:3.0:1790773521.984276:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18722:x1877761484552832:12345-192.168.202.19@tcp:101:dd.0 Request processed in 247us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773521.984283:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1790773522.012901:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.013097:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553088 00000100:00100000:2.0:1790773522.013108:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553088 00000100:00100000:2.0:1790773522.013173:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1790773522.013184:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18722:x1877761484553088:12345-192.168.202.19@tcp:103:dd.0 00010000:00010000:2.0:1790773522.013200:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773522.013277:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a6e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a1 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.013298:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773522.013303:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773522.013354:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484553088:12345-192.168.202.19@tcp:103:dd.0 Request processed in 171us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.013362:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1790773522.015483:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.015682:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553216 00000100:00100000:2.0:1790773522.015691:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553216 00000100:00100000:2.0:1790773522.015734:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:2.0:1790773522.015757:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484553216:12345-192.168.202.19@tcp:58:dd.0 00010000:00010000:2.0:1790773522.015857:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.015874:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.015885:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790773522.017842:0:25725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790773522.017867:0:25725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790773522.018073:0:25725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790773522.018291:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27f9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484553216:12345-192.168.202.19@tcp:58:dd.0 Request processed in 2529us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.018302:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1790773522.024698:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.024774:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553344 00000100:00100000:3.0:1790773522.024785:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553344 00000100:00100000:3.0:1790773522.024839:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:3.0:1790773522.024846:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+27:18722:x1877761484553344:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1790773522.024865:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773522.024883:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2a8 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024930:0:22683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024938:0:22683:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024967:0:22683:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024977:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024987:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773522.024989:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790773522.024992:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 28 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.024998:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d26c4a2a00, rc 0) 00000100:00100000:3.0:1790773522.025049:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18722:x1877761484553344:12345-192.168.202.19@tcp:101:dd.0 Request processed in 204us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.025054:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1790773522.253479:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496186752:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.253551:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.253602:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496187264:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.253624:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.253644:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496187776:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.253671:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.253690:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496186624:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.253693:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496188288:0@lo:400:kworker.0 00000100:00100000:1.0:1790773522.253771:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496186752 00000100:00100000:1.0:1790773522.253778:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496186752 00000100:00100000:1.0:1790773522.253817:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187264 00000100:00100000:1.0:1790773522.253821:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187264 00000100:00100000:1.0:1790773522.253836:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790773522.253844:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496186752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790773522.256441:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187776 00000100:00100000:0.0:1790773522.256456:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187776 00000100:00100000:0.0:1790773522.256524:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790773522.256537:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496187776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.261773:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.261838:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d14480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496186880:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.261889:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.261917:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496187392:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263564:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263633:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496187136:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263684:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263702:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496187648:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263722:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263733:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496188160:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263755:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263775:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1790773522.263782:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790773522.263824:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263842:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496187008:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263863:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263879:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496187520:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.263899:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263918:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496188032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790773522.263937:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773522.263991:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496186880 00000100:00100000:3.0:1790773522.263999:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496186880 00000100:00100000:3.0:1790773522.264043:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187008 00000100:00100000:3.0:1790773522.264045:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187008 00000100:00100000:3.0:1790773522.264056:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187520 00000100:00100000:3.0:1790773522.264058:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187520 00000100:00100000:3.0:1790773522.264072:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773522.264080:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496186880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.264130:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496186880:12345-0@lo:400:kworker.0 Request processed in 50us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.264137:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790773522.264153:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773522.264160:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496187008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.264189:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496187008:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.264195:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790773522.264224:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773522.264231:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496187520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.264259:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496187520:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265247:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.265272:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d1445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496187904:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265294:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.265329:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d14480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496186880:0@lo:400:kworker.0 00010000:00010000:2.0:1790773522.265418:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773522.265428:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d27e37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496188416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790773522.265450:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790773522.265472:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496188288 00000100:00100000:2.0:1790773522.265478:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496188288 00000100:00100000:2.0:1790773522.265506:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187136 00000100:00100000:2.0:1790773522.265509:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187136 00000100:00100000:2.0:1790773522.265519:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187648 00000100:00100000:2.0:1790773522.265521:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187648 00000100:00100000:2.0:1790773522.265530:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496188160 00000100:00100000:2.0:1790773522.265532:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496188160 00000100:00100000:2.0:1790773522.265544:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187904 00000100:00100000:2.0:1790773522.265546:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187904 00000100:00100000:2.0:1790773522.265591:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773522.265599:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265636:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3604:x1877761496188288:12345-0@lo:400:kworker.0 Request processed in 38us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265642:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790773522.265655:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790773522.265664:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496187136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265691:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1437d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1877761496187136:12345-0@lo:400:kworker.0 Request processed in 32us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265697:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790773522.265716:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790773522.265720:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496187648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265746:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1877761496187648:12345-0@lo:400:kworker.0 Request processed in 26us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265751:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790773522.265761:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773522.265766:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496188160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265809:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d2526cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1877761496188160:12345-0@lo:400:kworker.0 Request processed in 43us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265815:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790773522.265826:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773522.265832:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496187904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.265863:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1877761496187904:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265869:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1790773522.265898:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445df100 x1877761496187904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790773522.265902:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496186752:12345-0@lo:400:kworker.0 Request processed in 11415us (11707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.265917:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3605:1877761496187904:0@lo:400:kworker.0 00000100:00100000:1.0:1790773522.265922:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790773522.265944:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790773522.265953:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496187264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773522.265992:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3604:x1877761496187264:12345-0@lo:400:kworker.0 Request processed in 41us (12366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773522.265998:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1790773522.266017:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790773522.266028:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790773522.266030:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773522.266033:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790773522.266048:0:22676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496186624 00000100:00100000:1.0:1790773522.266052:0:22676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496186624 00000100:00100000:1.0:1790773522.266086:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790773522.266093:0:22676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3607:x1877761496186624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790773522.266128:0:22676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65cda49-ef94-4b32-a3e4-9e24580a945a+24:3607:x1877761496186624:12345-0@lo:400:kworker.0 Request processed in 37us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773522.266135:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1790773522.267595:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790773522.267625:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496187392 00000100:00100000:3.0:1790773522.267631:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496187392 00000100:00100000:3.0:1790773522.267682:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773522.267690:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.267760:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496187392:12345-0@lo:400:kworker.0 Request processed in 70us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.267766:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790773522.267788:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496186496 00000100:00100000:3.0:1790773522.267792:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496186496 00000100:00100000:3.0:1790773522.267809:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496188032 00000100:00100000:3.0:1790773522.267811:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496188032 00000100:00100000:3.0:1790773522.267820:0:24192:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496188416 00000100:00100000:3.0:1790773522.267823:0:24192:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496188416 00000100:00100000:3.0:1790773522.267834:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773522.267839:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496186496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790773522.267864:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790773522.267898:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d144546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1877761496186496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.267904:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790773522.267915:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773522.267921:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496188032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790773522.267944:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790773522.267971:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496188032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.267977:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790773522.267988:0:24192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790773522.268001:0:24192:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496188416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790773522.268016:0:24192:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1790773522.268382:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790773522.268521:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496187392:0@lo:400:kworker.0 00010000:00080000:2.0:1790773522.268556:0:3604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93d1445ddc00 x1877761496188288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790773538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790773522.268568:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3604:1877761496188288:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268603:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d281b9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496186752:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268626:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3604:1877761496187264:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268721:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790773522.268732:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3607:1877761496187008:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268742:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496187520:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268754:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496188032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790773522.268763:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1437df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a65cda49-ef94-4b32-a3e4-9e24580a945a:3607:1877761496186624:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268774:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3607:1877761496187136:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268785:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3607:1877761496187648:0@lo:400:kworker.0 00000100:00100000:2.0:1790773522.268804:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3607:1877761496188160:0@lo:400:kworker.0 00000100:00100000:3.0:1790773522.268844:0:24192:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3605:x1877761496188416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 841us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.268853:0:24192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790773522.268866:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d27e37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3605:1877761496188416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790773522.276272:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3604:x1877761496187776:12345-0@lo:400:kworker.0 Request processed in 19729us (22591us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773522.276289:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790773522.276982:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d1445dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3604:1877761496187776:0@lo:400:kworker.0 00000040:00080000:0.0:1790773522.701522:0:22719:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790773522.701532:0:22719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790773522.701555:0:22719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1790773522.701577:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1790773522.701702:0:22719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed69880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22719:1877761496188544:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790773522.701801:0:22719:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773522.706467:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.706578:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553472 00000100:00100000:2.0:1790773522.706590:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553472 00000100:00100000:2.0:1790773522.706656:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1790773522.706668:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484553472:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790773522.706707:0:22684:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790773522.706866:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484553472:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 200us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.706874:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:3.0:1790773522.707529:0:22719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed69880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22719:1877761496188544:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790773522.710598:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.710742:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553600 00000100:00100000:3.0:1790773522.710755:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553600 00000100:00100000:3.0:1790773522.710879:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1790773522.710890:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18724:x1877761484553600:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790773522.710989:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711010:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711024:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711042:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711048:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711055:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711082:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711108:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711115:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790773522.711171:0:25725:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790773522.711176:0:25725:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790773522.711189:0:25725:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711200:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711236:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711244:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711250:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773522.711254:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711262:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711276:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d243aca000) 00010000:00010000:3.0:1790773522.711279:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773522.711284:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711299:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3400/0xabf1cc0bc7843a83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711313:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711319:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711325:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711329:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26c4a3800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773522.711333:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711338:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711345:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff93d280936500) 00010000:00010000:3.0:1790773522.711348:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773522.711351:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711358:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3800/0xabf1cc0bc7843a8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711372:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711378:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711390:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711629:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2532e5c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773522.711633:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711641:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711650:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773522.711653:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790773522.711656:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.711662:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843a91 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.711770:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18724:x1877761484553600:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 881us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.711781:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1790773522.717694:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.717821:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553856 00000100:00100000:2.0:1790773522.717844:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553856 00000100:00100000:2.0:1790773522.717958:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1790773522.717969:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+28:18724:x1877761484553856:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.718009:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773522.718029:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843a98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2af expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718135:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718151:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718163:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773522.718174:0:22684:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790773522.718289:0:22684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718297:0:22684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718305:0:22684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718311:0:22684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.718315:0:22684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718323:0:22684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718342:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773522.718346:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790773522.718351:0:22684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718357:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843a9f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718413:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843a98 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2af expref: 30 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718423:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d243aca000) 00010000:00010000:2.0:1790773522.718426:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790773522.718429:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843a98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2af expref: 30 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.718439:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d24166ea00, rc 0) 00000100:00100000:2.0:1790773522.718518:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484553856:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 551us (834us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1790773522.718526:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1790773522.722053:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.723575:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484553984 00000100:00100000:0.0:1790773522.723675:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484553984 00000100:00100000:0.0:1790773522.724044:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1790773522.724056:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484553984:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790773522.724094:0:22685:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790773522.724268:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484553984:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 214us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773522.724277:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1790773522.731647:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.731921:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484554240 00000100:00100000:0.0:1790773522.731931:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484554240 00000100:00100000:0.0:1790773522.732003:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1790773522.732014:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+29:18724:x1877761484554240:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790773522.732037:0:22683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790773522.732187:0:22683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843aad lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2b6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790773522.732783:0:22683:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:0.0:1790773522.733025:0:22683:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:0.0:1790773522.733118:0:22683:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1790773522.733906:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c1a00/0xabf1cc0bc7843ab4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.733924:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c1a00/0xabf1cc0bc7843ab4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.733935:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c1a00/0xabf1cc0bc7843ab4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.733999:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843aad lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2b6 expref: 32 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.734040:0:22683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c1a00/0xabf1cc0bc7843ab4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2b6 expref: 31 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.734151:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d243aca800) 00010000:00010000:0.0:1790773522.734154:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790773522.734158:0:22683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2465c1a00, rc 0) 00000100:00100000:0.0:1790773522.734244:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+31:18724:x1877761484554240:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2233us (2609us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1790773522.734251:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1790773522.744456:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.744544:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484554496 00000100:00100000:2.0:1790773522.744555:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484554496 00000100:00100000:2.0:1790773522.744663:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1790773522.744673:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+31:18724:x1877761484554496:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.744733:0:25725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773522.744761:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c1a00/0xabf1cc0bc7843ab4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2b6 expref: 31 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744801:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d243aca800) 00010000:00010000:2.0:1790773522.744815:0:25725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790773522.744840:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744853:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744862:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744875:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744881:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744888:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744936:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744945:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744952:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744957:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166ea00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.744962:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744976:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744985:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773522.744988:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.744992:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.744999:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166ea00/0xabf1cc0bc7843ac2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745010:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745015:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745021:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745026:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166f400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.745029:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745034:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745041:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa3f59701 (ffff93d26ff75600) 00010000:00010000:2.0:1790773522.745044:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.745046:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.745062:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166f400/0xabf1cc0bc7843ac9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa3f59701 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.745158:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+30:18724:x1877761484554496:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 485us (724us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790773522.745166:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1790773522.749833:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.749940:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484554624 00000100:00100000:2.0:1790773522.749951:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484554624 00000100:00100000:2.0:1790773522.750017:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1790773522.750028:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+30:18724:x1877761484554624:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.750051:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773522.750078:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc7843ad0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2bd expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750115:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843ad7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750130:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843ad7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750143:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843ad7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750321:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e7c00/0xabf1cc0bc7843ad0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2bd expref: 32 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750339:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527200/0xabf1cc0bc7843ad7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2bd expref: 31 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.750359:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:2.0:1790773522.750362:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790773522.750366:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527200, rc 0) 00000100:00100000:2.0:1790773522.750419:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+31:18724:x1877761484554624:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 393us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.750426:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1790773522.759515:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.759622:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484554880 00000100:00100000:0.0:1790773522.759633:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484554880 00000100:00100000:0.0:1790773522.759697:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1790773522.759707:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+31:18724:x1877761484554880:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790773522.759799:0:22685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.759819:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.759832:0:22685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790773522.759999:0:22685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1790773522.760009:0:22685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665561803606ns, next at 666561801637ns, rc = 0 00000004:00010000:0.0:1790773522.760057:0:22685:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019578486 reply state 00000000da676102 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.760089:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.760097:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:0.0:1790773522.760100:0:22685:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790773522.760103:0:22685:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790773522.760246:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+33:18724:x1877761484554880:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 498us (700us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1790773522.760254:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1790773522.762450:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.762536:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555008 00000100:00100000:2.0:1790773522.762546:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555008 00000100:00100000:2.0:1790773522.762616:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1790773522.762626:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+33:18724:x1877761484555008:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.762651:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773522.762670:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2c4 expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.762724:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 34 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.762738:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 34 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.762755:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:2.0:1790773522.762758:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790773522.762761:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526000, rc 0) 00000100:00100000:2.0:1790773522.762820:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+34:18724:x1877761484555008:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 195us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.762842:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1790773522.765652:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.765792:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555136 00000100:00100000:3.0:1790773522.765802:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555136 00000100:00100000:3.0:1790773522.765872:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1790773522.765882:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d272cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2398:x1877761484555136:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790773522.766132:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d272cfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2398:x1877761484555136:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 250us (489us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1790773522.766141:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00080000:1.0:1790773522.766442:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790773522.768992:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.769090:0:22686:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555392 00000100:00100000:0.0:1790773522.769101:0:22686:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555392 00000100:00100000:0.0:1790773522.769160:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773522.769170:0:22686:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+34:18724:x1877761484555392:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790773522.769427:0:22686:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+35:18724:x1877761484555392:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 258us (444us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1790773522.769435:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1790773522.771981:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.772166:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555648 00000100:00100000:2.0:1790773522.772176:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555648 00000100:00100000:2.0:1790773522.772273:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1790773522.772282:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+35:18724:x1877761484555648:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790773522.772391:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+35:18724:x1877761484555648:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 110us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.772398:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:1.0:1790773522.775365:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.775673:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555776 00000100:00100000:2.0:1790773522.775684:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555776 00000100:00100000:2.0:1790773522.775749:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1790773522.775759:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+35:18724:x1877761484555776:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.775784:0:22684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773522.775807:0:22684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843aec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2cb expref: -99 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.775882:0:22684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.775898:0:22684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.775909:0:22684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790773522.775954:0:22684:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790773522.775973:0:22684:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.776016:0:22684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526c00/0xabf1cc0bc7843aec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2cb expref: 37 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.776039:0:22684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2cb expref: 36 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.776048:0:22684:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:2.0:1790773522.776051:0:22684:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790773522.776054:0:22684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241527c00, rc 0) 00000100:00100000:2.0:1790773522.776132:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+36:18724:x1877761484555776:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 375us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.776140:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1790773522.779959:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.780049:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484555904 00000100:00100000:2.0:1790773522.780062:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484555904 00000100:00100000:2.0:1790773522.780131:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1790773522.780141:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+6:2397:x1877761484555904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790773522.780159:0:24585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790773522.780180:0:24585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2d2 expref: -99 pid: 24585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790773522.780240:0:24585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abd0912, blocks: 0x0 00010000:00010000:2.0:1790773522.780363:0:24585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=665s v=(0 0) 00010000:00010000:2.0:1790773522.780369:0:24585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773522.780379:0:24585:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 7 pid: 24585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.780423:0:24585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 7 pid: 24585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.780438:0:24585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d241526a00, rc 0) 00000100:00100000:2.0:1790773522.780517:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2397:x1877761484555904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 377us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.780525:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1790773522.787861:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.787997:0:22685:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556160 00000100:00100000:2.0:1790773522.788008:0:22685:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556160 00000100:00100000:2.0:1790773522.788081:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1790773522.788092:0:22685:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+36:18724:x1877761484556160:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790773522.788461:0:22685:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+36:18724:x1877761484556160:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 369us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.788481:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1790773522.791582:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.791799:0:22684:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556288 00000100:00100000:2.0:1790773522.791810:0:22684:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556288 00000100:00100000:2.0:1790773522.791897:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1790773522.791907:0:22684:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+36:18724:x1877761484556288:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790773522.793994:0:22663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1790773522.794010:0:22663:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1790773522.794059:0:22663:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1790773522.794308:0:3590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794321:0:3590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794328:0:3590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794335:0:3590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:3.0:1790773522.794340:0:3590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794348:0:3590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794364:0:3590:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:3.0:1790773522.794367:0:3590:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790773522.794373:0:3590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.794379:0:3590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e200/0xabf1cc0bc784394f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.794527:0:22684:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+19:18724:x1877761484556288:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 2617us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.794536:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1790773522.794785:0:3606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496188672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790773522.794844:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773522.795004:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496188672 00000100:00100000:0.0:1790773522.795012:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496188672 00000100:00100000:0.0:1790773522.795062:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790773522.795071:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1877761496188672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790773522.795192:0:24190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790773522.795195:0:24190:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790773522.795198:0:24190:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790773522.795200:0:24190:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790773522 -> 1790773522 00002000:00010000:0.0:1790773522.795202:0:24190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790773522.795386:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3606:x1877761496188672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (541us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1790773522.795394:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1790773522.795468:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d143ce1c00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1790773522.795475:0:3606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3606:1877761496188672:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1790773522.795724:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795734:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795740:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795752:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fc00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.795767:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795777:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795789:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93d26ff75e00) 00010000:00010000:2.0:1790773522.795793:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.795797:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795803:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fc00/0xabf1cc0bc78438ed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795821:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795827:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795832:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795836:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166fa00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.795838:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795844:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795861:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93d26ff75000) 00010000:00010000:2.0:1790773522.795863:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.795866:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795872:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166fa00/0xabf1cc0bc78438f4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795885:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795892:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795897:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795902:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d26b5e6c00 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.795905:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795911:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795919:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93d243aca500) 00010000:00010000:2.0:1790773522.795921:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.795923:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795929:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26b5e6c00/0xabf1cc0bc78439aa lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795957:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795963:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795968:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795974:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2465c0800 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.795977:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795983:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.795991:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:2.0:1790773522.795993:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790773522.795996:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796000:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0800/0xabf1cc0bc7843a67 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796010:0:3591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796016:0:3591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796023:0:3591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796033:0:3591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2465c0200 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:2.0:1790773522.796037:0:3591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796043:0:3591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796051:0:3591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:2.0:1790773522.796053:0:3591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790773522.796056:0:3591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.796061:0:3591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0200/0xabf1cc0bc7843ade lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22685 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773522.798637:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.798759:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556416 00000100:00100000:2.0:1790773522.798769:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556416 00000100:00100000:2.0:1790773522.798825:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773522.798835:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2398:x1877761484556416:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790773522.798959:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2398:x1877761484556416:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.798966:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1790773522.801381:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.801502:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556672 00000100:00100000:3.0:1790773522.801513:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556672 00000100:00100000:3.0:1790773522.801579:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1790773522.801589:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+15:18724:x1877761484556672:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790773522.801676:0:25725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773522.801702:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241527c00/0xabf1cc0bc7843af3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2cb expref: 15 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.801722:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:3.0:1790773522.801727:0:25725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790773522.801754:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843b01 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.801780:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.801789:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790773522.801913:0:25725:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3b7bae5 reply state 00000000453ff9a9 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843b01 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.801925:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5c00/0xabf1cc0bc7843b01 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.801932:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:3.0:1790773522.801934:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790773522.801937:0:25725:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790773522.802037:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+16:18724:x1877761484556672:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 449us (665us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1790773522.802044:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1790773522.804366:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.804631:0:24189:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556800 00000100:00100000:3.0:1790773522.804641:0:24189:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556800 00000100:00100000:3.0:1790773522.804694:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1790773522.804718:0:24189:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:18724:x1877761484556800:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790773522.804737:0:24189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773522.804754:0:24189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2d9 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.804798:0:24189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.804808:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773522.804812:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773522.804817:0:24189:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 8 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.804850:0:24189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.804865:0:24189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.804880:0:24189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24189:1877761496188800:192.168.202.19@tcp:104: 00000100:00100000:3.0:1790773522.804956:0:24189:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790773522.807117:0:24189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24189:1877761496188800:192.168.202.19@tcp:104: 00010000:00010000:3.0:1790773522.807150:0:24189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 8 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.807194:0:24189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4a00, rc 0) 00000100:00100000:3.0:1790773522.807290:0:24189:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:18724:x1877761484556800:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2574us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.807299:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1790773522.809021:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.809089:0:22670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484556928 00000100:00100000:3.0:1790773522.809099:0:22670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484556928 00010000:00010000:3.0:1790773522.809135:0:22670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.809180:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1790773522.809190:0:22670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:2397:x1877761484556928:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773522.809236:0:22670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773522.809273:0:22670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.809288:0:22670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.809313:0:22670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a03afa9/0xabf1cc0bc7843afa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d2 expref: 8 pid: 24585 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.809330:0:22670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773522.809334:0:22670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790773522.809341:0:22670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 7 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.809367:0:22670:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 7 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.809405:0:22670:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 7 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.809419:0:22670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22670:1877761496188928:192.168.202.19@tcp:105: 00000100:00100000:3.0:1790773522.809497:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d251163b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790773522.812937:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.813002:0:24585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557056 00000100:00100000:2.0:1790773522.813011:0:24585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557056 00000100:00100000:2.0:1790773522.813069:0:24585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1790773522.813077:0:24585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:2398:x1877761484557056:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790773522.813265:0:24585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790773522.813268:0:24585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790773522 00002000:00010000:2.0:1790773522.813271:0:24585:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790773521 00002000:00010000:2.0:1790773522.813273:0:24585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790773522 -> 1790773522 00002000:00010000:2.0:1790773522.813275:0:24585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790773522.813321:0:24585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:2398:x1877761484557056:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 244us (391us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790773522.813328:0:24585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1790773522.814106:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d143ce0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:22670:1877761496188928:192.168.202.19@tcp:105: 00010000:00010000:3.0:1790773522.814128:0:22670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773522.814164:0:22670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:2397:x1877761484556928:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4976us (5150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.814173:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1790773522.818111:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.818247:0:24190:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557184 00000100:00100000:0.0:1790773522.818258:0:24190:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557184 00000100:00100000:0.0:1790773522.818329:0:24190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1790773522.818338:0:24190:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:2397:x1877761484557184:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790773522.818553:0:24190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.818587:0:24190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 8 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.818596:0:24190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790773522.818600:0:24190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790773522.818615:0:24190:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.818653:0:24190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 8 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.818667:0:24190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 8 pid: 24189 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.818682:0:24190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24190:1877761496189056:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773522.818759:0:24190:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773522.822194:0:24190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24190:1877761496189056:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773522.822275:0:24190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773522.822499:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1790773522.822594:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557312 00000100:00100000:2.0:1790773522.822612:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557312 00010000:00010000:2.0:1790773522.822653:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 9 pid: 24189 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.822689:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1790773522.822697:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:2397:x1877761484557312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773522.822712:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773522.822732:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 9 pid: 24189 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.822745:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 9 pid: 24189 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.822786:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae043cb9/0xabf1cc0bc7843b08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2d9 expref: 9 pid: 24189 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.822828:0:22668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773522.822832:0:22668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790773522.822840:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.822851:0:22668:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.822925:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790773522.822981:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+8:2397:x1877761484557312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 284us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.822988:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:0.0:1790773522.825782:0:24190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825803:0:24190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825838:0:24190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825847:0:24190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825856:0:24190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825863:0:24190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2465c0400 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773522.825868:0:24190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825876:0:24190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825918:0:24190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.825926:0:24190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f99a6e/0xabf1cc0bc7843b0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.826025:0:24190:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d1445df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2397:x1877761484557184:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 7684us (7921us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773522.826036:0:24190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1790773522.830127:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.832512:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557568 00000100:00100000:0.0:1790773522.832530:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557568 00000100:00100000:0.0:1790773522.832805:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1790773522.832817:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+16:18724:x1877761484557568:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790773522.832907:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.832925:0:22683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 16 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.832936:0:22683:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.832972:0:22683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 16 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.832987:0:22683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 16 pid: 22683 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.833018:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189184:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773522.833116:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279eda240 going to sleep for 11 seconds 00000100:00100000:1.0:1790773522.836428:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.836698:0:22720:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557696 00000100:00100000:3.0:1790773522.836709:0:22720:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557696 00010000:00010000:3.0:1790773522.836752:0:22720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 17 pid: 22683 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790773522.836796:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1790773522.836806:0:22720:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+17:2397:x1877761484557696:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790773522.836825:0:22720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790773522.836832:0:22720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 17 pid: 22683 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836869:0:22720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 17 pid: 22683 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836892:0:22720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773522.836899:0:22720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 17 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836909:0:22720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836918:0:22720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836926:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.836947:0:22720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790773522.837013:0:22720:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+17:2397:x1877761484557696:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 207us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.837021:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00010000:00010000:0.0:1790773522.838116:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a3600/0xabf1cc0bc7843a60 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c29a expref: 16 pid: 22683 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.838134:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189184:192.168.202.19@tcp:104: 00010000:00010000:0.0:1790773522.838153:0:22683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838159:0:22683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838163:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838370:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838383:0:22683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 16 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838391:0:22683:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838422:0:22683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 16 pid: 22684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.838433:0:22683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 16 pid: 22684 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.838459:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189312:192.168.202.19@tcp:104: 00000100:00100000:0.0:1790773522.838521:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279edaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790773522.840718:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189312:192.168.202.19@tcp:104: 00000100:00100000:1.0:1790773522.840719:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1790773522.840750:0:22683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.840952:0:22668:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557824 00000100:00100000:2.0:1790773522.840961:0:22668:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557824 00010000:00010000:2.0:1790773522.840999:0:22668:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 17 pid: 22684 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.841081:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1790773522.841095:0:22668:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+17:2398:x1877761484557824:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790773522.841112:0:22668:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790773522.841118:0:22668:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 17 pid: 22684 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841130:0:22668:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 17 pid: 22684 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841166:0:22668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d241526000/0xabf1cc0bc7843ae5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2c4 expref: 17 pid: 22684 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841182:0:22668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:2.0:1790773522.841187:0:22668:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841196:0:22668:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841230:0:22668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.841259:0:22668:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790773522.841282:0:22683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.841289:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.841309:0:22668:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+16:2398:x1877761484557824:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 219us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.841316:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000001:00080000:0.0:1790773522.841400:0:22683:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1790773522.841534:0:22683:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1790773522.841667:0:22683:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1790773522.841744:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22683:1877761496189440:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790773522.841782:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773522.841825:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d143130840 going to sleep for 11 seconds 00000100:00100000:2.0:1790773522.841868:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496189440 00000100:00100000:2.0:1790773522.841874:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496189440 00000100:00100000:2.0:1790773522.841912:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790773522.841919:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22683:x1877761496189440:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790773522.841999:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22683:x1877761496189440:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790773522.842006:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790773522.842611:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22683:1877761496189440:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790773522.842751:0:22683:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1790773522.842792:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22683:1877761496189568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790773522.842820:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773522.842839:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96180 going to sleep for 11 seconds 00000100:00100000:2.0:1790773522.844007:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496189568 00000100:00100000:2.0:1790773522.844019:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496189568 00000100:00100000:2.0:1790773522.844064:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790773522.844073:0:22689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22683:x1877761496189568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790773522.844306:0:22689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22683:x1877761496189568:12345-0@lo:1000:mdt00_000.0 Request processed in 232us (1483us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1790773522.844314:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790773522.844362:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22683:1877761496189568:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790773522.844413:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844426:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844434:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844438:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2465c0400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773522.844442:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844503:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844517:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:0.0:1790773522.844520:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773522.844523:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844527:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0400/0xabf1cc0bc7843b1d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844555:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844558:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844562:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844597:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d24166e400 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:0.0:1790773522.844670:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844677:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844686:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:0.0:1790773522.844688:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790773522.844695:0:22683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 19 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844707:0:22683:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 19 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844716:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 19 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.844777:0:22683:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d26c4a2a00/0xabf1cc0bc7843a7c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2a8 expref: 19 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790773522.844792:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189696:192.168.202.19@tcp:105: 00000100:00100000:0.0:1790773522.844868:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93d279e96480 going to sleep for 11 seconds 00000100:00100000:1.0:1790773522.847966:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.848528:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22683:1877761496189696:192.168.202.19@tcp:105: 00010000:00010000:0.0:1790773522.848557:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.848579:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d24166e400/0xabf1cc0bc7843a75 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848746:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848762:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848775:0:22683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848787:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848793:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848800:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848816:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12b600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773522.848821:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848828:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848839:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:1.0:1790773522.848843:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790773522.848846:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848852:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12b600/0xabf1cc0bc7843b24 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848862:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848867:0:22683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848872:0:22683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848877:0:22683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d2465c0600 already unused, calling callback (ffffffffc1adc4f0) 00010000:00010000:1.0:1790773522.848880:0:22683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848885:0:22683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848905:0:22683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:1.0:1790773522.848907:0:22683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790773522.848911:0:22683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.848917:0:22683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2465c0600/0xabf1cc0bc7843b16 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790773522.849162:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+19:18724:x1877761484557568:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 16345us (19043us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1790773522.849173:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000020:00080000:1.0:1790773522.849179:0:22683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790773522.850091:0:22719:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790773522.850098:0:22719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790773522.850114:0:22719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1790773522.850121:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1790773522.851872:0:3599:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773522.851959:0:22687:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484557952 00000100:00100000:1.0:1790773522.851970:0:22687:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484557952 00000100:00100000:1.0:1790773522.852009:0:22687:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558208 00000100:00100000:1.0:1790773522.852012:0:22687:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558208 00000100:00100000:1.0:1790773522.852030:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1790773522.852039:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+20:18722:x1877761484557952:12345-192.168.202.19@tcp:49:dd.0 00000100:00100000:1.0:1790773522.852185:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143066450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+20:18722:x1877761484557952:12345-192.168.202.19@tcp:49:dd.0 Request processed in 146us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773522.852193:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1790773522.852274:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1790773522.852281:0:22687:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+19:18724:x1877761484558208:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790773522.852557:0:22687:0:(mdd_object.c:4189:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790773522.852742:0:22687:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1790773522.852778:0:22687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852808:0:22687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852819:0:22687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852828:0:22687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852835:0:22687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852842:0:22687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.852926:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790773522.852985:0:22687:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d143ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18724:x1877761484558208:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 704us (1123us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1790773522.852992:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000020:00080000:1.0:1790773522.852997:0:22687:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790773522.855126:0:22672:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790773522.855145:0:22672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.855177:0:22672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12ac00 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:3.0:1790773522.855181:0:22672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.855190:0:22672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.855359:0:22672:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93d26ff75a00) 00010000:00010000:3.0:1790773522.855363:0:22672:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790773522.855369:0:22672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.855376:0:22672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d27b12ac00/0xabf1cc0bc7843b2b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.855595:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773522.855598:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790773522.855600:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790773522.859645:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1790773522.859732:0:25725:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558336 00000100:00100000:3.0:1790773522.859746:0:25725:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558336 00000100:00100000:3.0:1790773522.859809:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1790773522.859819:0:25725:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+21:18722:x1877761484558336:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1790773522.859848:0:25725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790773522.859869:0:25725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7843b32 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b101ea2e9e6c2e0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.859905:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843b39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.859920:0:25725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843b39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.859932:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843b39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.860063:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e5200/0xabf1cc0bc7843b32 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2e0 expref: 23 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.860083:0:25725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d2532e4000/0xabf1cc0bc7843b39 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x2b101ea2e9e6c2e0 expref: 22 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790773522.860092:0:25725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93d243acac00) 00010000:00010000:3.0:1790773522.860095:0:25725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790773522.860098:0:25725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d2532e4000, rc 0) 00000100:00100000:3.0:1790773522.860169:0:25725:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+22:18722:x1877761484558336:12345-192.168.202.19@tcp:101:dd.0 Request processed in 350us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773522.860176:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:0.0:1790773522.884048:0:3598:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773522.884180:0:24193:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558464 00000100:00100000:1.0:1790773522.884190:0:24193:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558464 00000100:00100000:1.0:1790773522.884294:0:24193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1790773522.884305:0:24193:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2397:x1877761484558464:12345-192.168.202.19@tcp:4:dd.0 00002000:00010000:1.0:1790773522.884357:0:24193:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6abd0912, atime: 0x6abd0911, ctime: 0x6abd0912, blocks: 0x0 00010000:00010000:1.0:1790773522.884368:0:24193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.884406:0:24193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=665s v=(0 0) 00010000:00010000:1.0:1790773522.884412:0:24193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790773522.884420:0:24193:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790773522.884435:0:24193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.892690:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773522.892865:0:24195:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1790773522.892876:0:24195:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1790773522.893152:0:24195:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558592 00000100:00100000:0.0:1790773522.893162:0:24195:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558592 00000100:00100000:2.0:1790773522.894070:0:25730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:2.0:1790773522.894087:0:25730:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+9:2397:x1877761484558592:12345-192.168.202.19@tcp:4:dd.0 00010000:00010000:2.0:1790773522.894126:0:25730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.894146:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773522.894150:0:25730:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790773522.894158:0:25730:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.894174:0:25730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790773522.956905:0:24184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1790773522.956927:0:24184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1790773522.957173:0:24193:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1790773522.957177:0:24193:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1790773522 -> 1790773523 00002000:00010000:0.0:1790773522.957180:0:24193:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1790773522 -> 1790773523 00002000:00010000:0.0:1790773522.957181:0:24193:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1790773522.957200:0:24193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957377:0:24193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957388:0:24193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957396:0:24193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d27b12a800 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:0.0:1790773522.957400:0:24193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957410:0:24193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957430:0:24193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790773522.957456:0:24193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060df18b3/0xabf1cc0bc7843b40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.966273:0:24193:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+7:2397:x1877761484558464:12345-192.168.202.19@tcp:4:dd.0 Request processed in 81952us (82217us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1790773522.966290:0:24193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000001:00080000:3.0:1790773522.997181:0:24184:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1790773522.997573:0:25730:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1790773522.997578:0:25730:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1790773522.997672:0:25730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997701:0:25730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997711:0:25730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997718:0:25730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d241526000 already unused, calling callback (ffffffffc0eb2ac0) 00010000:00010000:2.0:1790773522.997722:0:25730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997731:0:25730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997749:0:25730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790773522.997756:0:25730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027db9d5a/0xabf1cc0bc7843b47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790773522.997901:0:25730:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484558592:12345-192.168.202.19@tcp:4:dd.0 Request processed in 103813us (105217us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1790773522.997912:0:25730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00010000:00010000:2.0:1790773523.277652:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790773523.278081:0:3607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496189824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790773523.278180:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773523.278419:0:24191:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496189824 00000100:00100000:3.0:1790773523.278428:0:24191:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496189824 00000100:00100000:3.0:1790773523.278699:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790773523.278709:0:24191:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496189824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790773523.278734:0:24191:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1790773523.278793:0:24191:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1877761496189824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773523.278799:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790773523.278937:0:3607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3607:1877761496189824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790773523.504241:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773523.504297:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773523.504329:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773523.504336:0:22677:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558720 00000100:00100000:0.0:1790773523.504347:0:22677:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558720 00000100:00100000:1.0:1790773523.504358:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773523.504379:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773523.504396:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773523.504399:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:0.0:1790773523.504410:0:22677:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2397:x1877761484558720:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773523.504413:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1790773523.504427:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773523.504501:0:22677:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26c396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c41b0d0c-f917-4aa4-9d74-ef94f8de06ab+13:2397:x1877761484558720:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773523.504509:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:0.0:1790773523.504548:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559232 00000100:00100000:0.0:1790773523.504551:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559232 00000100:00100000:0.0:1790773523.504593:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559744 00000100:00100000:0.0:1790773523.504596:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559744 00000100:00100000:0.0:1790773523.504610:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559104 00000100:00100000:0.0:1790773523.504612:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559104 00000100:00100000:1.0:1790773523.504613:0:3597:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1790773523.504623:0:24188:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559616 00000100:00100000:0.0:1790773523.504625:0:24188:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559616 00000100:00100000:0.0:1790773523.504661:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1790773523.504667:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484559232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1790773523.504711:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790773523.504715:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790773523.504717:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484559232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773523.504723:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1790773523.504730:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558976 00000100:00100000:1.0:1790773523.504733:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558976 00000100:00100000:0.0:1790773523.504736:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1790773523.504740:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1790773523.504747:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790773523.504766:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559488 00000100:00100000:1.0:1790773523.504769:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559488 00000100:00100000:0.0:1790773523.504775:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00080000:1.0:1790773523.504780:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790773523.504781:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1790773523.504791:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484558848 00000100:00100000:0.0:1790773523.504793:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1790773523.504794:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484558848 00000100:00100000:0.0:1790773523.504799:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484559104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1790773523.504818:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773523.504822:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484559104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773523.504828:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1790773523.504838:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1790773523.504840:0:22683:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761484559360 00000100:00100000:1.0:1790773523.504843:0:22683:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761484559360 00000100:00100000:0.0:1790773523.504844:0:24188:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1790773523.504853:0:22679:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790773523.504866:0:24188:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773523.504867:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1790773523.504872:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1790773523.504873:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484558976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773523.504900:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+5:2397:x1877761484558976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773523.504906:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1790773523.504920:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1790773523.504927:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773523.504951:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+5:2397:x1877761484559488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773523.504957:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1790773523.504968:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1790773523.504974:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+22:2397:x1877761484558848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773523.505011:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a9031e1-1696-4ed7-99a1-a67115ed7fee+22:2397:x1877761484558848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773523.505017:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1790773523.505029:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1790773523.505034:0:22683:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2397:x1877761484559360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1790773523.505061:0:22683:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d25074f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df26e5e5-3d13-4e64-9b40-d2ff05f45a18+6:2397:x1877761484559360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790773523.505067:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1790773524.301487:0:3604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496189952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790773524.301569:0:3604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790773524.301652:0:22688:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496189952 00000100:00100000:3.0:1790773524.301662:0:22688:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496189952 00000100:00100000:3.0:1790773524.301712:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790773524.301733:0:22688:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d27e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496189952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790773524.301769:0:22688:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00010000:00010000:0.0:1790773524.301908:0:22672:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790773524.302451:0:3605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496190080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790773524.302487:0:3605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790773524.302518:0:22689:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1790773524.302526:0:22689:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1790773524.302634:0:22689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877761496190080 00000100:00100000:0.0:1790773524.302640:0:22689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877761496190080 00000100:00100000:0.0:1790773524.302751:0:25749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790773524.302762:0:25749:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496190080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790773524.302785:0:25749:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1790773524.302820:0:25749:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d26ed6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3605:x1877761496190080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790773524.302833:0:25749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790773524.302871:0:3605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d26ed6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3605:1877761496190080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790773524.303116:0:22688:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff93d27e37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3604:x1877761496189952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1382us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790773524.303123:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790773524.307399:0:3604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93d25074ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3604:1877761496189952:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1790773524.518144:0:25768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1790773524.877692:0:22719:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790773524.877703:0:22719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790773524.877748:0:22719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1790773524.877760:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1790773525.327081:0:22671:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13882 lines, 13882 kept, 0 dropped, 0 bad.